The head of South Africa’s budget office resigned last week, after helping the National Treasury stabilize public debt.