Chollet: base LLMs have ~0 fluid intelligence, LRMs saturated ARC 1 in 2025
fchollet · x · 2026-10-02
François Chollet argues the key distinction between base LLMs and modern LRMs isn't symbolic tool use but a paradigm shift: from transduction (intuiting the answer) to induction (intuiting the program/reasoning chain that produces the answer).
- LRMs are trained for test-time induction — predicting an NL program at inference — which unlocks fluid intelligence, something base LLMs still have essentially zero of.
- Evidence: base LLMs remain at 10-15% on ARC 1 (a 2019 benchmark); scaling 100,000x only moved them from 0% to 10%. LRMs of the same or smaller size saturated ARC 1 in 2025.
Related event: Chollet and Gary Marcus Debate AI Paradigm Shifts and Symbolic Tools(4 posts)→
More from Models
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- Nathan Lambert calls out Ethan Mollick for 'selectively ignoring' Kimi in model comparisons — natolambert · 2026-11-16
- Stealth Anthropic model spotted in Devin build as METR chart shows frontier pace up 1.4x — daniel_mac8 · 2026-11-16
- Eval Firm Trajectory Told 40 Agents "NEVER Stop" in Harness Without Telling Epoch — peterwildeford · 2026-11-16
- Unsloth Q8 crushes default Q3 in a self-hosted test over 331 financial PDFs — No_Cartographer3953 · 2026-11-16