The seaside town was ranked 108th out of 118 places in a Which? survey, but residents and businesses on the ground tell a very different story