François Chollet: Deep Learning Will Eventually Be Replaced by Discrete Program Search
fchollet · x · 2026-08-02
François Chollet points out that to address deep learning's limitations, the AI field has widely adopted the first patch: active inference at test time. While this brings meaningful progress, it remains an incremental improvement rather than the ultimate solution.
He emphasizes that long-term, AI will inevitably shift to the second approach: overhauling the training mechanism itself. This requires moving away from deep learning (curve fitting) and SGD altogether, embracing discrete program search to truly tackle complex reasoning.
More from AGI Musings
- DHH: Starship, Starlink and Grok should have been Europe's Sputnik moments — georgemillo · 2026-10-16
- Hinton hits back at Jensen Huang: 'He has good reason to say AI isn't dangerous — he sells Nvidia chips' — BlackHC · 2026-10-16
- Yudkowsky blasts new interpretability finding as primitive; critic pushes back on doomer logic — AlexTensor · 2026-10-16
- Beff Jezos declares 'civilizational inflection point' in the acceleration of technological progress — beffjezos · 2026-10-16
- Data scientist: pivoting to AI engineering is the safest career bet for the next 5 years — mdancho84 · 2026-10-16
- AI will be superhuman at science regardless, and Europe can't opt out — teortaxesTex · 2026-10-16