LittleLearner: a 5B model trained from scratch on a K-5-only corpus tests education data limits
repligate · x · 2026-09-12
Researchers trained LittleLearner, a 5B-parameter model built from scratch on LittleCurriculum, a corpus restricted to K–5 material, to make testable what happens when an LLM never sees anything beyond fifth-grade content. The model is open for public chat, with an experiment thread detailing the setup.
More from Research
- ICLR 2026 paper MoM: multiple memory states fix linear models' recall weakness — kastnerkyle · 2026-09-12
- Harvard researcher turned a fruit fly brain connectome into a Bitcoin trading bot — Scobleizer · 2026-09-12
- LLMs ace hard problems but miss the basics: KST study of 8 models vs 18,000 humans — rohanpaul_ai · 2026-09-12
- RSI-Exam opens 35 of 88 tasks, hailed as the next SWE-bench for self-improving AI — cihangxie · 2026-09-12
- SuperFlex: Deformable Superquadrics for Point Cloud Decomposition, 10000x Faster Than Marching Primitives — orlitany · 2026-09-12
- Synthetic Morphology Suggests Non-Physicalist Models of Mind Can Be Empirically Tested — ZeroStateReflex · 2026-09-12