Chollet: reasoning chain generation is search, not interpolation
teortaxesTex · x · 2026-11-16
François Chollet argues that while a curve fitted via SGD can only interpolate by construction, using that curve as a sampling guide in a search process means you're doing search — theorem proving and reasoning chain generation are search. teortaxesTex pushes back: if so, what exactly were we interpolating — the structure of outputs but not their actual distribution?
More from AGI Musings
- Pangram can't tell AI-written from AI-edited text, sparking career-ruining false labels — TuhinChakr · 2026-11-16
- Viral quip: Building things brutally reveals which of your smarts were merely verbal — StewartalsopIII · 2026-11-16
- Ben Todd: AI may reshape the $3T annual R&D spend, not just white-collar wages — ben_j_todd · 2026-11-16
- 40% of game developers use generative AI, and most think it hurts the industry — Aizkmusic · 2026-11-16
- Demis Hassabis: AGI is coming and the entire education system needs to be flipped — minsuk_chang · 2026-11-16
- Claude user rebuts Erik Hoel's 'Qualiaphobia' AI safety proposal: a test engineered to fail proves nothing — repligate · 2026-11-16