Fchollet: If AI extinction risk were real, we'd regulate it like nukes
fchollet · x · 2026-09-13
François Chollet laid out a logical dilemma: if AI truly has a high chance of causing human extinction within years or decades, the only rational stance is stringent top-down government involvement and universally ratified international treaties, as with nuclear non-proliferation. He argues only two positions are coherent: (1) the near-term extinction risk is real and taken seriously, demanding maximally heavy-handed regulation; or (2) the risk isn't real, actual risks are mild, so mild safety measures and self-certification suffice. Saying 'this could end humanity in your lifetime' while winging it is simply irrational — implying nobody involved seriously believes the extinction narrative.
Related event: Chollet Warns AI Safety Proposals May Be Regulatory Capture(2 posts)→
More from AGI Musings
- Agents get stronger weekly yet still solve the wrong problem: AI takeover ETA? — BarriosA2I · 2026-09-13
- Founder Bindu Reddy: Near-zero chance digital AI destroys humanity, robots are the real risk — bindureddy · 2026-09-13
- Robotics race is about teleoperation economics: US pays $150K per operator, China a third — paigeinsf · 2026-09-13
- "Nobody wrote the Matrix" essay lands on Reddit, arguing AI coding dies by 2036 — TMWNN · 2026-09-13
- Galactica veteran teases revival of 'stranger pre-trained models' reasoning direction — rosstaylor90 · 2026-09-13
- Reddit essay: criminalize anthropomorphizing LLMs, ban AI friends and therapists — jaykayenn · 2026-09-13