The minister turned the criticism back on the Coalition, questioning its record on housing construction.