Local outreach workers say they were unaware the family was struggling and would have provided food had they been asked