Nick Cannon had his hands full with his kids Tuesday ... taking them to dinner at a famous Los Angeles hot spot -- though he couldn't manage to get his whole brood together. The actor and rapper was spotted leaving Craig's -- a well-known joint in…