Composing Continual Learning Mechanisms Boosts Long-Horizon Retention from 1.2% to 34.9%
_akhaliq · x · 2026-09-17
A new paper, Continual Learning Mechanisms Compose for Long-Horizon Memorization, tackles catastrophic forgetting with a simple recipe: compose multiple continual learning mechanisms. Across 3 datasets, average final retention rises from 1.2% with naive sequential SFT to 34.9% — a 28-fold improvement — substantially extending memory lifetime.
More from Research
- Adobe & UCLA's Tev: verifiable progress rewards lift long-horizon agent Pass@5 from 0.17 to 0.28 — jiqizhixin · 2026-11-02
- Old trick still works: portal sampling cuts path-tracing noise dramatically at 64spp — ssh4net · 2026-11-02
- Marcel Böhme's paper asks why cybersecurity can never be solved, proposes vulnerability-guided hardening — mboehme_ · 2026-11-02
- Perplexity open-sources WANDR: 500 research tasks, 170,495 evidence points, URL-rechecking grader — thisguyknowsai · 2026-11-02
- AI researcher: we have no reliable way to tell whether an AI system is conscious — dioscuri · 2026-11-02
- Ant Group's Venus-DefakerOne2 hits 96% accuracy detecting AI-generated videos — inclusionAI · 2026-11-02