A technical case against RSI: transformers have capacity limits, more data causes forgetting
gerardsans · x · 2026-09-12
gerardsans makes a technical argument that RSI is a nothing burger: software isn't smooth or infinite — once layers, inputs, outputs and parameters are set, it's done. AI is probabilistic but still software; a transformer has a finite capacity, and you can't train a model indefinitely — continued training with more data leads to catastrophic forgetting.
Related event: Researchers Push Back on Dario Amodei's Claim That RSI Has Begun(8 posts)→
More from AGI Musings
- Five agents can agree because they made the same mistake, krishnan warns with satire — krishnan · 2026-10-31
- Google's earnings offer clearest look yet at the cruel economics of AI search — dinabass · 2026-10-31
- Stanford 12-month study of 439 users: heavy AI companion use sticks, well-being drops via less human contact — stanfordnlp · 2026-10-31
- Wired AI Lab: Codex tried to bench Erling Haaland in a fantasy football experiment — willknight · 2026-10-31
- a16z: B300 GPU rentals up 106% since July while average token prices fall 58% — a16z · 2026-10-31
- Stanford's TaskNet builds occupational task inventories from worker interviews at scale — stanfordnlp · 2026-10-31