The castle sits on a sandstone bluff overlooking the River Avon and has served as a stronghold, a royal residence and later a grand country house.