The former prince has been told to reign in the horse riding amid fears it will come off as a 'bad look', royal sources say