The Albanese Government has been warned there is a good reason it should not hand out cash in the next federal budget.