Small Expert Models Will Outperform 'Mainframe AI'
markjeffrey · x · 2026-07-19
The author agrees with Andrej Karpathy that **small expert models** are the future, rather than 'mainframe AI'. Karpathy points out that current LLMs waste a massive amount of parameter capacity on useless junk data. True agents aren't magic; they are large-scale distillation. By combining **small models + the right tools + closed loops**, astonishing capabilities can be achieved.
More from Models
- Claude 20x users report sharply tighter limits and faster quota burn — MarcJSchmidt · 2026-07-21
- Cola launches July, the latest model jokingly billed as “second only to Fable” — oran_ge · 2026-07-21
- Kimi K3 looks stronger and about 5× cheaper on a frontend dashboard task — OwariDa · 2026-07-21
- Last Week in AI recap: Anthropic’s $65B round, IPO filing, and Microsoft’s MAI push — Last Week in AI · 2026-07-21
- A user says Claude 4.6 felt worse yesterday and asks whether model quality can drift over time — Rahios · 2026-07-21
- Kimi K3 hits 89.4% peak on software tasks while Fable 5 is slightly steadier — FinanceYF5 · 2026-07-21