"It’s going to come down to, ultimately, the territory, and how that territory is divided up," Matthew Whitaker said