Tricolor Holdings founder Daniel Chu was charged by federal prosecutors with conspiring to defraud lenders and investors of the company.