LeCun reaffirms autoregressive LLMs won't reach human-level AI, argues for search in continuous representation space

Scobleizer · x · 2026-09-21

Responding to Geoffrey Hinton's AI-danger campaign, Yann LeCun restates his claim that autoregressive LLMs alone won't lead to human-level AI. He argues current reasoning relies on non-autoregressive search done inefficiently in token space, while human-like reasoning should search a continuous representation space — a direction he says the industry is moving toward. He also notes current self-improvement methods only work where outputs can be scored without humans, such as math, code, and simulatable scenarios.

Related event: LeCun Reiterates Autoregressive LLMs Alone Won't Reach Human-Level AI(4 posts)→

Original post →

More from AGI Musings

AGI Musings channel →