The MP’s rebuttal came a day after cabinet ministers and other party leaders from Punjab slammed him for allegedly ignoring state-related issues