We sold our big single-family house when we became empty-nesters and downsized to a townhome. It has benefits, like no mortgage, and drawbacks.