Leading the protest, public works department minister Harbhajan Singh demanded an apology from the LoP