Organisers of the Festival of Childhood said the Greater Manchester Mayor – and supposed No 10 hopeful – was being replaced as keynote speaker.