A judge has been removed from a case that sparked debate over how accountable parents should be for their children’s reckless driving.