Australia's "most dangerous thing" caused multiple riders to drop out only a day after an "extreme" fire danger rating caused disruption.