Prime Minister in peril as calls grow in Labour ranks for him to stand down after he fails to stem revolt with keynote speech