Ministers are defending taking pay rises and accommodation entitlements as the Government looks to slash spending across the public service.