LeCun claims reasoning isn't autoregressive, peers push back: Fable works differently
paul_cal · x · 2026-09-21
- Yann LeCun restated his position that while underlying LLMs are autoregressive, modern AI systems are not: "reasoning" systems generate many token sequences and pick the best one — a form of non-autoregressive search in discrete token space, which he argues should instead happen in abstract representation space.
- paulcal quote-replied to dispute the premise: that's not how Fable or Astra actually work, and reasoning, planning and self-correction are far more amenable to autoregression than LeCun assumed.
- The exchange hits a core fault line in current reasoning-model design: where the search happens — token space vs. abstract representation space.
Related event: LeCun Reasserts Autoregressive LLMs Won't Reach Human-Level AI(6 posts)→
More from AGI Musings
- Google Cloud survey: 78% say legacy enterprise vendors may not lead the AI era — rseroter · 2026-11-12
- NYT essay: resisting Big Tech and AI takes collective action, not willpower — TuhinChakr · 2026-11-12
- Ethan Mollick: 'talk to your documents' RAG solutions already feel dated — emollick · 2026-11-12
- Anthropic's pitch hasn't changed in 5 years: 'AI is winner-take-all, we will build god' — menhguin · 2026-11-12
- Peter Diamandis: We have 6-18 months to reach 'Safe Superintelligence' — what is Ilya building? — PeterDiamandis · 2026-11-12
- AI observer: headcount is no longer a proxy for ambition — signulll · 2026-11-12