Arrests were made on Friday as dozens of police clashed with protesters over Brisbane's planned Olympic stadium at Victoria Park.