US President Donald Trump first floated the idea of an "invasion" of Venezuela as far back as 2017, Colombian ex-president Juan Manuel Santos said.