The pressure is mounting on Prime Minister Sir Keir Starmer, though he has vowed to fight any challenge to his position.