Plans to open a Greggs in one of the world’s “coolest” high streets have been scrapped after hundreds of objections.