A report by a former Scottish Government chief agriculture economist had suggested the benefits of the sector had been overstated.