The town is home to an ancient university, plenty of great places to eat and drink, and a fascinating history too.