Several former Victorian premiers have joined the chorus of leaders calling on Prime Minister Anthony Albanese to reverse his decision not to call a federal inquiry into antisemitism in Australia.