If labs aren't near RSI we're safe — otherwise we're at a dangerous point
moultano · x · 2026-09-11
moultano argues about recursive self-improvement (RSI) risk: he can't verify how close labs are to RSI beyond their own claims, and they say they're close. If we're not at a very dangerous point, then either the labs aren't as close as they think, or RSI has sharply diminishing returns. Everything past RSI looks Yudkowskian to him.
Related event: Google Engineer: Labs Say They're Near RSI, So We're in Danger Now(3 posts)→
More from AGI Musings
- People Neglect Human Agency Both Ways: Exaggerated Doom and Complacent Optimism — jankulveit · 2026-09-11
- Garrison Lovely's 'Obsolete' on AI Replacing Labor Lands September 2026 with Heavyweight Blurbs — GarrisonLovely · 2026-09-11
- AI Doom Skeptics Hit Back: EA-Driven Apocalypse Talk Doesn't Reflect Most Top-Tier Researchers — GarrisonLovely · 2026-09-11
- Over 1,000 AI Policy Initiatives Launched in 70+ Countries, but the Governance Gap Widens — CurieuxExplorer · 2026-09-11
- Swedish tech veteran: Dyson spheres now feel 'inevitable' — 90% excited, 10% terrified — erikstarck · 2026-09-11
- Creativity is the reward for a well-stocked knowledge base, not the opposite of memorization — mmmbchang · 2026-09-11