‘Rude, arrogant and entitled’ Andrew served his own interests, minster says