Some who previously spoke out with concerns around the party’s finances claim to have been ‘demonised’.