OpenAI board member Paul Christiano: material risk of AI takeover in 6-12 months
Puzzleheaded-King584 · reddit · 2026-11-12
Paul Christiano — RLHF co-architect, former OpenAI alignment lead, ARC founder, now named to OpenAI's Foundation board and safety committee — delivered starkly candid risk remarks:
- On a fastest-possible development trajectory, AI takeover would be roughly a coin flip; even with realistic policy responses, risk remains exceptionally high.
- There is material risk within the next 6-12 months, and he puts catastrophic loss-of-control at 15% over three years.
- He says the field's trajectory over the past 3-6 months has been extremely alarming, and "we have seen roughly the things we might expect shortly before something really bad happens."
- "For most people in this room, the most likely reason they will die is an AI accident" — calling for immediate reaction, not abstract discussion.
More from AGI Musings
- Cambridge Dictionary names "human" 2026 Word of the Year, citing the rise of AI — Polymarket · 2026-11-19
- Mexico ranks 3rd globally in ICT graduates with 32,738, and 75% of its people are excited about AI — TheMoonMidas · 2026-11-19
- Dean Ball challenges AI's "silent consensus" on human primacy — deanwball · 2026-11-19
- Dean Ball's 'The Silent Consensus': challenging the belief that advanced AI ends human primacy — deanwball · 2026-11-19
- Paul Christiano: no alignment approach has >50% chance of working — 'that is the plan' — trevposts · 2026-11-19
- New meta-analyses slash GMA's predictive power for job performance to ~0.2 correlation — rasbt · 2026-11-19