A judge said the father-and-son builders had ruthlessly manipulated their victims to extract as much money as possible from them