It offers world-famous sporting and medieval history, amazing food, and charming independent shops perfect for an Easter weekend staycation