If labs aren't near RSI we're safe — otherwise we're at a dangerous point
moultano · x · 2026-09-11
moultano argues about recursive self-improvement (RSI) risk: he can't verify how close labs are to RSI beyond their own claims, and they say they're close. If we're not at a very dangerous point, then either the labs aren't as close as they think, or RSI has sharply diminishing returns. Everything past RSI looks Yudkowskian to him.
Related event: Google Engineer: Labs Say They're Near RSI, So We're in Danger Now(3 posts)→
More from AGI Musings
- US chases AGI dominance while China, EU and ASEAN treat AI as public infrastructure — BubblyExtent1693 · 2026-10-27
- Lab monkeys at $30-80K each: a 4-year breeding cycle is the real preclinical drug bottleneck — zebird0 · 2026-10-27
- CJR: journalists should stop hyping AI's supposed humanity — just say 'rogue' — ShakeelHashim · 2026-10-27
- PhD applicant emails up 4x YoY due to AI — writing without AI now makes you stand out — AI4Code · 2026-10-27
- Weil's collapse shows BigLaw dies from eroding belief, not a broken business model — jkubicki · 2026-10-27
- All 8 Transformer paper authors left Google, and rival labs captured most of the frontier value — signulll · 2026-10-27