Federal Treasurer Jim Chalmers has turned down the chance to rule out changes to the negative gearing tax break.