The city has been awarded Purple Flag accreditation for a second year in a row, but some locals say they feel unsafe regardless