Karpathy defines the LLM 'Cognitive Core': On-device, tool-using, and trainable
cephaloform · x · 2026-08-18
Andrej Karpathy outlines the vision for an LLM 'Cognitive Core': a few-billion-parameter model that sacrifices encyclopedic knowledge for capability, running locally as a kernel for personal computing. Key features include native multimodality, Matryoshka-style scaling for capability, reasoning, aggressive tool use, and on-device LoRA slots for personalization. It delegates complex checks to cloud oracles when online.
More from Models
- Qwen3.8 27B defaults to xhigh reasoning to maximize benchmark performance — frontsideair · 2026-08-18
- Sol 5.6 Ultra shows repetitive outputs, likely RL fried — Miles_Brundage · 2026-08-18
- Gemini Flash generates 3D physics code in minutes — AI_Andrew · 2026-08-18
- Grok's Awkward Output Draws Mockery: "My Wife Wouldn't Approve" — moultano · 2026-08-18
- Sakana Namazu model now available on Vercel AI Gateway — SakanaAILabs · 2026-08-18
- Claude Fails Miserably at Reading Markdown Files — yoobinray · 2026-08-18