Local residents have expressed their frustration as caravans moved back onto the site, sparking fresh concerns over property damage