Safety researcher: AI labs only align the next two models, nothing beyond
geoffreyirving · x · 2026-09-10
Geoffrey Irving recounts a conversation with a recent AI safety lead at a frontier lab: the org chart has Team A aligning the next model and Team B the one after that — but no one is working on aligning later models.
He adds that pressure inside AI companies to do emergency safety patching crowds out work that would hold up to superintelligence, so that longer-term work simply doesn't happen.
More from AGI Musings
- Understanding the AI consciousness debate: which theory of mind is behind it — msharmas · 2026-10-27
- Functionalism: if consciousness is just what the brain computes, silicon can run it too — msharmas · 2026-10-27
- iPhone case with 85,000 reviews in days: everything fake in the age of abundance — tekbog · 2026-10-27
- Whether AI can be conscious depends on your definition: five frameworks for thinking about it — msharmas · 2026-10-27
- dunkhippo33 Shares How He Thinks About Raising Kids in the AI Era — kimmonismus · 2026-10-27
- EE-trained AI educator: systems-bottleneck thinking still matters in the AI era — dunkhippo33 · 2026-10-27