'The damage that could have been inflicted could have been very large and taken out a good portion of our leaders,' a former agent said.