Public displays of bonhomie between PM and the American leader had yielded little diplomatic dividend, says Opposition party