Tensions threatened to spill over in the city as anti-immigration activists marched through a counter-rally, waving Australian flags.