The Centre for Family Violence and Sexual Violence Prevention could see a third of its workforce slashed.