How policymakers and technologists are debating AI tail risks, using dark speculation, wargaming and insurance-style analysis to guide future AI standards.