FULL STORY

Chollet's Shift: Endorsing Test-Time Compute over Scaling

Keras founder François Chollet shifted his stance on LLMs, acknowledging that test-time compute breakthroughs in models like o3 changed his mind after previously questioning pure parameter scaling.

2026-08-02 ~ 2026-08-08 · 2 episodes · 9 posts

Episode 1 · François Chollet: Test-Time Compute is Key as Pure Parameter Scaling Hits Limits (2026-08-02, 4 posts)

François Chollet stated that while pure parameter scaling has hit a bottleneck, test-time compute and post-training scaling have broken through these limitations. He emphasized that these approaches still have a 10x to 100x room for improvement, with program search being the ultimate path to AGI.

Episode 2 · Keras Creator Admits Underestimating LLMs, o3 Test-Time Compute as Turning Point (2026-08-07, 5 posts)

Keras creator François Chollet posted on social media to reflect and admit that he underestimated the long-term importance of large language models (LLMs) from 2023 to early 2024. He explicitly stated that the breakthrough in test-time compute achieved by the o3 model in late 2024 was the key turning point that completely changed his view. He also clarified that some of his earlier judgments still hold: base LLMs will hit capability ceilings, scaling laws alone are not the only path to AGI, and he predicts LLMs will eventually be superseded by methods like symbolic learning.

Confirmed

  • Chollet confirmed that he underestimated the potential of LLMs as a foundation for building fluent intelligent systems from 2023 to early 2024.
  • The key turning point was the breakthrough in test-time compute by the o3 model in December 2024.
  • He clarified that some of his earlier judgments still hold: base LLMs will hit capability ceilings, and scaling laws alone are not the only path to AGI.
  • He believes LLMs will eventually be replaced by methods like symbolic learning.

Why it matters

As a highly influential researcher in AI, Chollet's change of view signals growing recognition of the test-time compute approach, which could influence future directions in AI system architecture.