Kathryn Ruemmler said last month she would leave Goldman Sachs at the end of June after fallout over her emails with Jeffrey Epstein.