A charming UK city steeped in history has been deemed 'too dangerous' by locals because of beggars on the high street.