"There exist credible apprehensions regarding the independence and ability of Surajit Roy in discharging his duties as returning officer," says Mr. O'Brien