The exit comes as a significant blow to the Congress party, which has already faced internal turmoil ahead of the elections