A 'Queer Eye' star skipped an interview promoting the show, claiming he's been 'mentally and emotionally abused for years'