LeCun reiterates autoregressive LLMs won't reach human-level AI as industry shifts to continuous reasoning

ccerrato147 · x · 2026-09-21

Chamath resurfaced a 2023 exchange between Geoffrey Hinton and Yann LeCun on AI safety, noting LeCun's warning that doomerism inadvertently helped those seeking to lock down AI research and open-source. In the quoted post, LeCun reasserts that autoregressive LLMs alone won't lead to human-level AI: current reasoning relies on non-autoregressive search done in token space—limited and inefficient—while human-like reasoning should be search in continuous representation space, a direction the industry is now moving toward. He also argues today's self-improvement methods only work in domains where output quality can be scored without humans, like math and code.

Related event: LeCun Reasserts Autoregressive LLMs Won't Reach Human-Level AI, Calling for Reasoning in Continuous Representation Space(6 posts)→

Original post →

More from AGI Musings

AGI Musings channel →