Victoria Premier Jacinta Allan has dismissed speculation against her leadership, calling it "anonymous gossip".