Plans for more than 150 homes on the edge of a village have moved forward, despite some fearing it will “negatively affect” their properties.