The Irish language commissioner has insisted he was “trying to distance” himself from a group’s decision to work towards a united Ireland.