Controversial plans to tear down a former nursery school and replace it with flats have been withdrawn for the second time in four months.