The job market has consistently fluctuated between gains and losses since May. Lower immigration and an aging population are affecting the workforce.