A city is turning on its mayor after many blame her for allowing a 6-story affordable-housing building to be built in the town's center.