Panhandling, public intoxication and encampments have taken over the once-charming tourist destination, locals say