François Chollet Clarifies LLM Stance: Test-Time Compute Breaks Base Model Bottlenecks
fchollet · x · 2026-08-02
François Chollet clarified his evolving stance on Large Language Models (LLMs), stating that his past criticisms of base LLMs do not apply to systems utilizing test-time compute (TTA). He compared the difference to steam trains versus modern electric bullet trains—similar in appearance, but fundamentally different in underlying principles.
Chollet noted that he updated his views in December 2024, no longer believing that the LLM tech platform (enhanced with TTA) would stall. He emphasized that if we look strictly at base models without TTA, they still perform poorly on the 2019 ARC 1 benchmark, despite roughly a 100,000x increase in compute scaling. The paradigm shift to test-time compute, rather than simply scaling single-pass static inference, is what enables today's state-of-the-art systems to achieve advanced reasoning.
More from AGI Musings
- AI Agents to Trigger Massive Supply Chain Cyberattacks on Small Manufacturers — robleclerc · 2026-08-02
- Ethical Debate: When Will Manual Driving Become Obsolete? — cgarciae88 · 2026-08-02
- Why Multimodal Input Matters for AGI: DeepSeek & Anthropic's Approach — dotey · 2026-08-02
- MIT's Catalini: Traditional Moats Fail in AI Era, Only Verification-Grade Network Effects Survive — kimmonismus · 2026-08-02
- LLM Data Analysis Trap: Models Invent the Conclusions You Want to Hear — Mulberry_Morris · 2026-08-02
- AI Devalues Knowledge? Analyst Warns of Trillions in Consumer Debt at Risk — churchkey · 2026-08-02