Jewish Green member voices concern about ‘swathes’ of former Labour activists joining Zack Polanski’s party