Anthony Albanese's hopes of passing his hate speech laws have suffered a blow, with both the Coalition and the Greens threatening to withhold support.