Aleksandre Elisashvili was arrested on Saturday morning after being accused of trying to set a government building alight