With an estimated 1 million feral deer in Victoria causing untold damage to farms and the environment, farming and green groups have thrown down the gauntlet.