The 38-year-old is currently on bail charged with possession of an offensive weapon in a public place