The IRS has fired a quarter of its staff, and more cuts are coming. That's makes people think Uncle Sam has taken his eye off the ball.