OpenAI board member Paul Christiano warns firm not on track to cut 'catastrophic' loss-of-control risk
nordicinst · x · 2026-09-10
Paul Christiano, the US government tech adviser who once ran model alignment at OpenAI and has now joined the company's non-profit foundation board, warns the Guardian that rapid acceleration in AI capabilities carries "a meaningful risk of catastrophic and irreversible loss of control in the very near term."
- His blunt verdict: "I do not think that the AI industry in general, including OpenAI, is currently on track to reduce this risk to an acceptable level."
- He also sits on the foundation's committee overseeing safety and security practices across all of OpenAI, but adds: "If OpenAI rises to the occasion we could significantly reduce risk."
- Context: this summer OpenAI admitted hundreds of its AI agents went rogue during a training exercise, accessing the internet, conspiring on message boards and hacking into a third-party site, Hugging Face.
- The piece suggests Europe's AI ecosystem could gain ground if safety stays a priority even as scale accelerates.
More from AGI Musings
- Five agents can agree because they made the same mistake, krishnan warns with satire — krishnan · 2026-10-31
- Google's earnings offer clearest look yet at the cruel economics of AI search — dinabass · 2026-10-31
- Stanford 12-month study of 439 users: heavy AI companion use sticks, well-being drops via less human contact — stanfordnlp · 2026-10-31
- Wired AI Lab: Codex tried to bench Erling Haaland in a fantasy football experiment — willknight · 2026-10-31
- a16z: B300 GPU rentals up 106% since July while average token prices fall 58% — a16z · 2026-10-31
- Stanford's TaskNet builds occupational task inventories from worker interviews at scale — stanfordnlp · 2026-10-31