Safety concerns, along with poverty and homelessness, were among the top reasons cited for the decline.