The retired swimming star and husband Andy Parsons were 'cautiously overjoyed' when they announced they were expecting earlier this year