Some residents have objected to the plans and the potential impact they think it will have on their homes