While wasps might be the ones pushing the homeowners out, researchers believe human action could be playing a role too.