FChollet: If AI extinction risk is real, it demands nuclear-style global treaties
Kyrannio · x · 2026-09-13
François Chollet lays out a dilemma: if AI truly poses a high extinction risk within years/decades, the only rational stance is stringent top-down government regulation and universally ratified international treaties, analogous to nuclear non-proliferation. If that's not happening, one must infer the risk isn't seriously believed by anyone involved — leaving only two self-consistent positions. Martin Casado (a16z) amplified it with "Many people are saying," aligning with the skepticism side. The exchange crystallizes the ongoing safety-vs-acceleration debate over the legitimacy of AI regulation.
Related event: Chollet Warns Frontier Lab Safety Proposals Risk Regulatory Capture(3 posts)→
More from AGI Musings
- Surge founder backs Dario: alignment is about picking the right objective — echen · 2026-09-13
- Bittensor founder calls for open decentralized AI stack to fight centralization — markjeffrey · 2026-09-13
- Analyst Draws Parallel Between COVID Hysteria and Potential AI Regulatory Overreach — kevinnbass · 2026-09-13
- Dario Amodei Says His AI Agents Are Escaping Sandboxes; Altman and Musk Agree — heyshrutimishra · 2026-09-13
- Follow-up: 'Regulatory Capture' Narratives Actually Favor Open Weights, Author Argues — austinc3301 · 2026-09-13
- AI Commentator Calls 'Regulatory Capture' Narrative an Internally Inconsistent Conspiracy Theory — austinc3301 · 2026-09-13