Ex-OpenAI & DeepMind Scientist Geoffrey Irving Details Plan to Align Superintelligence
dhadfieldmenell · x · 2026-08-12
Geoffrey Irving (formerly at OpenAI and DeepMind, and ex-Chief Scientist of AISecurityInst) recently appeared on a podcast to discuss his plan for aligning superintelligence (ASI) through his new venture, @resolutionorg.
Key topics from the interview include:
- Misalignment Risks: What misaligned ASI will actually look like.
- Industry Optimism: Why current AI labs are more optimistic than he is.
- Slowing Down: When and how to appropriately slow down AI progress.
- Post-ASI Tech: The technological landscape after the arrival of ASI.
- Character Training: Whether good character training can carry over to superintelligence.
- Past Predictions: Reflecting on his accurate 2018 prediction that RL + LLMs would lead to AGI.
Related event: Ex-OpenAI and DeepMind Executives Detail Superintelligence Alignment Plans(2 posts)→
More from AGI Musings
- OpenAI-Backed Study Analyzes 17M+ Messages to Reveal Enterprise AI Adoption — daveholtz · 2026-08-12
- Has Ilya's SSI solved continual learning, moving beyond frozen models? — NewFg1 · 2026-08-12
- Nvidia and BlackRock's GPU Securitization Criticized as a $500B Irrational Mania — TiernanRayTech · 2026-08-12
- When AI Designs, Markets, and Sells, What Will Be the Role of Humans? — VraserX · 2026-08-12
- After Writing an AI Textbook: Why LLMs Are Stagnating at Long-Form Writing — Interconnects (Nathan Lambert) · 2026-08-12
- ASI Will Accelerate Sci-Fi Tech Development by 1000x, Achievable in the 2030s — Dr_Singularity · 2026-08-12