Prime Minister Anthony Albanese has defended breaking his promise not to make change to property tax laws.