Group of MPs and peers warn the move could set 'worrying precedent' for other organisations to feel they must follow suit