A top Tory accused Sir Keir Starmer's government of "ducking the big choices and putting rearmament on hold".