Even as the sector opens up to greater competition and foreign investment, long-standing challenges continue to constrain its reach and credibility