Chollet: reasoning chain generation is search, not interpolation

teortaxesTex · x · 2026-11-16

François Chollet argues that while a curve fitted via SGD can only interpolate by construction, using that curve as a sampling guide in a search process means you're doing search — theorem proving and reasoning chain generation are search. teortaxesTex pushes back: if so, what exactly were we interpolating — the structure of outputs but not their actual distribution?

Original post →

More from AGI Musings

AGI Musings channel →