Same toy benchmark, different budgets: PCA replay 91.1% vs joint 95.2%
BlackHC · x · 2026-09-16
In the author's continual learning experiments, SGD + PCA replay with 4 epochs per task reaches 91.1% ten-class accuracy, while regular joint training with 10 passes over all tasks' data gets 95.2%. Different budgets, one toy benchmark, 3 seeds — a useful reference, not a ceiling.
Related event: BlackHC's toy continual learning experiment: PCA replay hits 91.1%(6 posts)→
More from Research
- MIT's xvr aligns 2D X-rays with 3D scans in seconds at sub-millimeter precision — nordicinst · 2026-09-16
- AI researchers predicted 2054 for a Millennium Problem; reality arrived far sooner — ben_j_todd · 2026-09-16
- Paper2Agent turns research papers into interactive AI agents (Nature) — EricTopol · 2026-09-16
- CPAL 2027 heads to Tokyo: small conference on parsimony and learning — YiMaTweets · 2026-09-16
- Discrete Beckmann Transport Models: One-Step Discrete Generators Without a Teacher — rishabh16_ · 2026-09-16
- AI models are becoming appliances: great at one thing, bad at everything else — dbreunig · 2026-09-16