One expert said it ‘doesn’t take much’ to worsen Canadian views of the U.S. government after Trump threatened to take the country over