A school trip for five-and-six-year-old children to visit a synagogue has sparked controversy after parents pulled their children from the visit.