The first ever conference of the left wing 'Your Party' has descended into chaos - after one of their founders declared she was boycotting the event.