Should We Be Worried About the Artificial Dyes in our Food?

Robert F. Kennedy Jr. has argued that artificial dyes are "poisonous compounds" that are harming America's kids. Does he actually have a point?