The chef, 60, was axed from MasterChef earlier this year after being accused of using an ‘offensive racist term’