Mr Robertson has attracted controversy during his time in Holyrood, over issues including his handling of the most recent census.