Wall Street fears higher prices and slower growth will sink all stocks — but small-caps and housing hold their own.