The number of retirement-age Americans wanting to move abroad has more than quadrupled in the past 50 years.