Controversial plans to tear down a former nursery school and replace it with flats have been rehashed - but fears remain.