Eli Toby had previously appeared at a neo-Nazi rally outside NSW Parliament House before the Anzac Day incident.