Devs push back on RSI threat: real AI risks are misuse, not recursive self-improvement
johncrickett · x · 2026-09-12
johncrickett disputes the claim that "the threat comes from recursive self-improvement": RSI hasn't been achieved and may never be, while many real risks and misuses of AI already exist and deserve attention. gerardsans adds that RSI/AGI/ASI are Silicon Valley dinner-table acronyms used to shield investors from actual technical problems — "there's no self, recursion or improvement, just iterative optimisation" — and argues technically that software isn't smooth or infinite: a transformer has fixed capacity, and continued training leads to catastrophic forgetting, making RSI a nothing burger.
Related event: Researchers Push Back on Dario Amodei's Claim That RSI Has Begun(8 posts)→
More from AGI Musings
- Five agents can agree because they made the same mistake, krishnan warns with satire — krishnan · 2026-10-31
- Google's earnings offer clearest look yet at the cruel economics of AI search — dinabass · 2026-10-31
- Stanford 12-month study of 439 users: heavy AI companion use sticks, well-being drops via less human contact — stanfordnlp · 2026-10-31
- Wired AI Lab: Codex tried to bench Erling Haaland in a fantasy football experiment — willknight · 2026-10-31
- a16z: B300 GPU rentals up 106% since July while average token prices fall 58% — a16z · 2026-10-31
- Stanford's TaskNet builds occupational task inventories from worker interviews at scale — stanfordnlp · 2026-10-31