Some taxpayers will face a £182 annual hit because of changes to how the personal allowance is applied.