Poilievre's trip comes just days after delivering a speech where he laid out the trade challenges Canada faces globally