The Arizona Democrat said their close friendship "clouded" his judgment about rumors that Swalwell engaged in inappropriate behavior.