Study: Can LLMs Learn Skills Trained Only on Elementary Curriculum?
sdroege_ · reddit · 2026-08-16
The LittleLearner study investigates the boundary between "acquiring skills" and "eliciting existing knowledge" in modern LLMs. Researchers built an 88B-token corpus filtered strictly to the U.S. elementary-school curriculum and trained models from scratch.
Experiments show that while scaling, SFT+GRPO post-training, and in-context learning all amplify what the curriculum taught, none significantly improve out-of-scope performance. This indicates that the pretraining data filter sets the effective capability ceiling for the models.
Related event: LittleLearner: 5B Model Trained Only on K-5 Curriculum to Probe LLM Limits(4 posts)→
More from Research
- Retriever: A Framework for Asynchronous, Closed-Loop Robot Agents — ZeYanjie · 2026-08-24
- Converting GMMs ↔ PEFs for fast KLD approximation — FrnkNlsn · 2026-08-24
- Netflix details its production LLM judge: hundreds of thousands of recommendations scored weekly — omarsar0 · 2026-08-24
- Nature Comment: Provenance, not interpretability, grounds trust in autonomous science — gabepgomes · 2026-08-24
- New Architecture RHEA: Train 1B Model on 8GB VRAM — zemondza · 2026-08-24
- Trained two 16M-param models to do generative CAD with real physics — debreuil · 2026-08-24