A UK city with its enchanting Georgian architecture and bustling high street offers a delightful blend of history and modern-day allure