"I was worried about raising our kids in L.A., in the culture of Hollywood," the actor recently told Esquire. He had other plans.