Opposition must face the consequences and answer the women, sources have said, quoting PM Modi during a cabinet meeting.