A man accused of displaying Nazi symbols has been caught in a tug of war between prosecutors and immigration authorities after he sought removal from Australia.