There is an "ideological disagreement" between Australia and the US on tariffs, Prime Minister Anthony Albanese has said.