LeCun stands firm: auto-regressive LLMs alone won't lead to human-level AI
ylecun · x · 2026-09-20
Yann LeCun reiterates that his statement "auto-regressive LLMs, in and of themselves, will not lead to human-level AI" remains totally true, with three arguments:
- Reasoning: Current systems rely on non-auto-regressive search, but in token space, which is limited and inefficient; human-like reasoning should be search in continuous representation space — a direction the industry is moving toward.
- Self-improvement: Today's self-improvement methods only work where outputs can be scored without human intervention (math, code, simulatable scenarios). Humans and animals learn far more efficiently than current RL.
- Multimodality: Current assistants use separately-trained components (post truncates here).
Related event: LeCun Reasserts Autoregressive LLMs Won't Reach Human-Level AI(6 posts)→
More from AGI Musings
- Agents' bottleneck isn't intelligence but goal commitment — and that's good for alignment — mimi10v3 · 2026-11-12
- Google Cloud survey: 78% say legacy enterprise vendors may not lead the AI era — rseroter · 2026-11-12
- Safety researchers blast OpenAI/Anthropic plan: automating alignment research with possibly misaligned AI — trevposts · 2026-11-12
- NYT essay: resisting Big Tech and AI takes collective action, not willpower — TuhinChakr · 2026-11-12
- Ethan Mollick: 'talk to your documents' RAG solutions already feel dated — emollick · 2026-11-12
- Anthropic's pitch hasn't changed in 5 years: 'AI is winner-take-all, we will build god' — menhguin · 2026-11-12