The reputation of King Charles' younger brother has taken a battering most notably due to his links to Epstein.