An extra week of annual leave for Aussies would be “significant” shift in the country’s workplace relations framework amid a major push for the change - but a leading business figure warns the downsides are substantial.