The sector has suffered from Labour’s move to push up wages and raise National Insurance contributions