5B LittleLearner trained only on K-5 material to test LLM limits

MatthewMcAteer0 · x · 2026-08-16

Researchers trained a 5B parameter model named LittleLearner from scratch using a corpus restricted to K-5 material (LittleCurriculum) to investigate how LLMs perform when their knowledge depth is constrained.

Related event: LittleLearner: 5B Model Trained Only on K-5 Textbooks to Probe LLM Limits(2 posts)→

Original post →

More from Research

Research channel →