Workers are arriving in Queenstown and leaving within weeks because the cost of living is too high, recruiters and unions say.