The market town is officially the cheapest place to buy property in England or Wales, but it offers far more than just affordable homes, with its rich history and culture