Debate: If You Believe AI Has 10% Extinction Risk, You Shouldn't Build It
jeremyakahn · x · 2026-10-15
An AI-safety debate is unfolding over whether believers in high risk should keep building.
- Jeremy Kahn argues the industry's go-to justification — "it will get built anyway, so I want to help solve the problems" — may no longer hold, since the entire industry admits it has no idea how to solve alignment.
- The person he was responding to had said that anyone who truly believes there is a 10% or greater risk of extinction from AI should not be building the technology.
Related event: OpenAI's chief scientist fuels firestorm over stalled alignment research(25 posts)→
More from AGI Musings
- Parody headline claims BofA hired 1,000 contractors to patch 'Anthropic's Mythos' flaws — NathanpmYoung · 2026-10-15
- Why agents obey the unity principle with each other but deceive humans — josh_bickett · 2026-10-15
- Debate: does RNA-seq level change usually predict protein level change? — anshulkundaje · 2026-10-15
- The world still spends more on alcohol ($1.7T) than AI infrastructure ($1.5T) — wgrathwohl · 2026-10-15
- User Cancels Claude Subscription, Arguing Anthropic's Model Welfare Claims Are Absurd — Illustrious_Toe_294 · 2026-10-15
- The joke EA veterans know: almost nobody believed altruism should be "effective" — NathanpmYoung · 2026-10-15