The final decision now rests with the Lok Sabha Speaker, though sources said the broad contours of the reshuffle have already been worked out.