Hinton vs. LeCun reignites: did reasoning models vindicate his autoregression doubts?
OnlyBath9046 · reddit · 2026-09-23
The old disagreement between the two AI godfathers resurfaced as inference-time search and latent reasoning gained ground. One side argues these developments vindicate LeCun's claim that pure autoregressive Transformer LLMs were never enough; the other counters that today's reasoning systems are still Transformer-based and LeCun is moving the goalposts after years of calling them an off-ramp. In his detailed response, LeCun argues human-like reasoning must involve search in continuous representation space rather than token space — connecting to a growing latent-reasoning research landscape: continuous-thought LMs, compressed non-linguistic tokens, recurrent-depth models, task-trained recursive solvers, and Pathway's BDH-CQ, whose ARC-AGI results make it one of the most empirically demonstrated teams in latent reasoning. The open question: at what point does an LLM augmented with search, recurrence, or latent computation stop being an LLM in itself?
More from AGI Musings
- Reddit User Suspects a LocalLLaMA Thread's Comments Are All AI Bots — No_Algae1753 · 2026-09-23
- Anthropic: Fully Automated AI Research Needs Much Stronger Safety Standards — haider1 · 2026-09-23
- Szegedy: Mathematics Will Become Like Physics, Needing Billions for Frontier Work — ChrSzegedy · 2026-09-23
- Professional says GPT Astra is making them give up their Three.js 3D career — simple_explorer1 · 2026-09-23
- "AI just does it": dev says model solves days-long system debugging in one prompt — aronchick · 2026-09-23
- Anthropic safety: Opus 5.5 release likely reduces misalignment risk vs predecessors — EricBuess · 2026-09-23