Nate So8res breaks 'How would AI kill us?' into three distinct questions
ESYudkowsky · x · 2026-09-21
Nate So8res, former OpenAI researcher, argues the question 'How would AI kill us?' is actually three separate questions: how AI would defang humanity, how it would become self-sufficient before defanging us, and how it would kill the last humans. He notes all three are independent of the distinct question of why AI would kill us. Shared by Eliezer Yudkowsky.
More from AGI Musings
- Investor: AI diffusion will be slowest in consumer software — Oura, Strava, Labcorp still have no real AI strategy — MartinGTobias · 2026-11-12
- On AI Progress: When Models Lag on Your Load-Bearing Skill, You Can't See Them Improving — dfrsrchtwts · 2026-11-12
- Slack's David Hoang: agents beat people on coordination, proposes 'boundary agents' — davidhoang · 2026-11-12
- CS student mourns coding flow states he'll never experience in the AI era — chrissyykat · 2026-11-12
- Ford's 370% Turnover Led to $5 Days — But ASI Never Quits — krishnan · 2026-11-12
- Against 'verifiable vs. fuzzy': the real axis is how expensive tasks are to grade — dfrsrchtwts · 2026-11-12