The Green Party leader has faced relentless criticism after he made the controversial remark to The Sun newspaper in 2013