Cole Palmer was substituted in Chelsea's 2-1 defeat to Aston Villa, with the England international visibly frustrated.