Keras Creator Admits Underestimating LLMs, Cites o3 Breakthrough as Turning Point
khademinori · x · 2026-08-07
François Chollet tweeted to clarify that he underestimated the long-term importance of LLMs back in early 2023. He admitted he initially didn't see LLMs working as a base for systems capable of fluid intelligence, and only changed his mind in late 2024 following the o3 test-time compute breakthrough. However, he emphasized that the early 2023 narrative—that merely scaling up base LLMs would solve AGI—did not pan out. New ideas and capabilities like TTC (test-time compute) and Harnesses are crucial to recent breakthroughs.
More from AGI Musings
- Duke Study of 4,439 People Finds Coworkers Quietly Rate AI Users as Lazier — aakashgupta · 2026-10-16
- DSPy Author's $70 O'Reilly Book Rejected by Engineer Who Now Just Tells Claude What to Do — lateinteraction · 2026-10-16
- 'A machine proving new math, a car driving up a wall': AI researcher on how weird it's getting — rand_longevity · 2026-10-16
- Yacine on training: 'Neural nets are lazy stupid idiots — I build hells to make them ubermensch' — yacineMTB · 2026-10-16
- Jeff Clune: Moving the Goalposts Will Be Humanity's Last Job — jeffclune · 2026-10-16
- Replit CEO Amjad Masad Says the Future of Work Is the 'Self-Driving Company' — TechCrunch AI · 2026-10-16