The president has called worries about high prices a ‘hoax’ and a ‘Democrat scam’. Many of his own voters disagree