Exclusive: The Prime Minister tears into political opponents blocking new homes and ‘driving a wedge between communities’