While rates were high in Toronto and Vancouver, where housing is especially costly, the trend is not entirely a result of affordability challenges