Albanese fronted up to explain a "difficult" and potentially unpopular decision that also walked back an election promise.