Karpathy Proposes "Cognitive Core" LLMs: Small Models That Strip Encyclopedic Knowledge

Andrej Karpathy introduced the concept of an LLM "cognitive core" — a billion-parameter-scale model that sacrifices encyclopedic knowledge for stronger reasoning. He argues that limiting or stripping memorization is key to better generalization.

2026-08-20 ~ 2026-08-21 · 2 related posts

• Karpathy: The 'Cognitive Core' of intelligence will be a tiny model — yacineMTB · 2026-08-20
• Karpathy: Future LLMs Will Shrink to 'Cognitive Core' by Shedding Knowledge — ZeroStateReflex · 2026-08-21