Prime Minister Anthony Albanese says his ministers must find savings for a May budget that insiders say will be pitched as a belt-tightening exercise.