The future Queen found the public comment to be completely "demoralising", according to royal author Christopher Andersen.