Runtime Learning Isn't Enough; Structural Write-Back Is Key
RichardSSutton · x · 2026-07-14
The author shares an observation on the difference between current AI and more general intelligence:
- Existing AI typically learns capabilities before deployment; general intelligence must continuously create, repair, and reorganize its capabilities on the fly.
- The key question isn't just "how to keep learning at runtime," but in what form experiences are retained: weights, predictions, policies, or reusable structures, constraints, failure modes, and verified paths.
- The conclusion: runtime learning might just be the beginning. What truly matters could be "runtime structural write-back," which converts experience into long-term intelligence.
More from AGI Musings
- ControlAI CEO says an international ban on superintelligence is needed to avert extinction risk — zetalyrae · 2026-07-22
- Gary Marcus says LLMs still cannot really do math on their own — GaryMarcus · 2026-07-22
- Gary Marcus says LLM math skills are like knowing only a car’s engine size — GaryMarcus · 2026-07-22
- AI may make digital work infinitely leveraged while offline life gets more human — illscience · 2026-07-22
- Better AI math could save researchers time by killing false conjectures earlier — prateekj · 2026-07-22
- AI’s economic forecasts are split by nearly a quadrillion dollars by 2035 — bittingthembits · 2026-07-22