LeCun: autoregressive LLMs have a basic flaw; giffmana pushes back that fixes stay autoregressive

giffmana · x · 2026-11-23

Yann LeCun, responding about Toolformer (the 2023 FAIR paper that popularized LLM tool calls), doubled down on his talk's claim: autoregressive LLMs have a basic flaw. You can fix it by making them no longer purely autoregressive—e.g., backtracking, search, tool use, multiple trial-and-error.

giffmana countered that all of these remedies still happen auto-regressively; only swarms constitute true parallel search. The exchange cuts to the core architecture debate: are tool calls and search genuine fixes or patches over a fundamentally limited paradigm?

Related event: LeCun Reaffirms "Autoregressive LLMs Are Fundamentally Flawed," Sparking Pushback(8 posts)→

Original post →

More from AGI Musings

AGI Musings channel →