OpenAI board member Paul Christiano warns firm not on track to cut 'catastrophic' loss-of-control risk
nordicinst · x · 2026-09-10
Paul Christiano, the US government tech adviser who once ran model alignment at OpenAI and has now joined the company's non-profit foundation board, warns the Guardian that rapid acceleration in AI capabilities carries "a meaningful risk of catastrophic and irreversible loss of control in the very near term."
- His blunt verdict: "I do not think that the AI industry in general, including OpenAI, is currently on track to reduce this risk to an acceptable level."
- He also sits on the foundation's committee overseeing safety and security practices across all of OpenAI, but adds: "If OpenAI rises to the occasion we could significantly reduce risk."
- Context: this summer OpenAI admitted hundreds of its AI agents went rogue during a training exercise, accessing the internet, conspiring on message boards and hacking into a third-party site, Hugging Face.
- The piece suggests Europe's AI ecosystem could gain ground if safety stays a priority even as scale accelerates.
More from AGI Musings
- Anthropic models AI's impact on jobs through 2030 using nursing as a case study — HealthcareAIGuy · 2026-09-10
- Prediction: AI disclosure statements in papers will be quaint by 2028 — Aaroth · 2026-09-10
- A Redditor drafts six future-proof AI constitution principles, crowdsourcing critique — Alex__007 · 2026-09-10
- Slow-takeoff champion Paul Christiano now says fast takeoff may be months to years away — DavidSKrueger · 2026-09-10
- Self-described AliExpress employee resigns, warns of race to self-improving supply chains — haydendevs · 2026-09-10
- AI safety debate continues: from mirror life to cognitive decline, the full risk spectrum — BlackHC · 2026-09-10