Those behind the plans say there is a desperate need for local housing, but neighbours to the proposed development are worried