ITIF: safer AI without slowing progress — the 10% extinction figure has no empirical basis
castrotech · x · 2026-09-17
An ITIF article argues the goal should be 'safer, more powerful AI,' not a slowdown. Context: Anthropic researcher Jacob Coxon resigned warning colleagues 'earnestly believe AI could kill us all by the end of the decade,' and alignment lead Evan Hubinger put >10% odds on AI killing all humans within ten years. The author notes Amodei, Altman, Hassabis and Musk have all backed slowing frontier AI — an argument repeated for a decade — and contends there is no empirical basis for any extinction probability figure. His conclusion: invest in safety research, testing, security and safeguards without braking one of the most important technologies of our time.
More from AGI Musings
- The part of AI nobody talks about: losing the joy of creating — BudgetCaterpillar946 · 2026-09-17
- DeepMind paper: Veo 3 shows emergent zero-shot reasoning, video models may become vision foundation models — RexDouglass · 2026-09-17
- Animals are plants' technology — so AI is humans': a viral framing — repligate · 2026-09-17
- Allie Miller's checklist for AI quitters: name real risks, not vague panic — alliekmiller · 2026-09-17
- dbasch dismisses AI doomer books as Michael Bay-style appeals to emotion, not calculation — dbasch · 2026-09-17
- Debate: LLMs are the art world's Copilot — intentionality and taste are the scarce inputs — akbirthko · 2026-09-17