The Prime Minister has softened his language on tweaks to a key tax that has been blamed for keeping young Australians out of the housing market.