The president has pushed back on the negative numbers, saying in a recent interview: "I don’t care about polling."