Can current LLM architecture reach AGI? An engineer lays out his doubts
mostly_deterministic · reddit · 2026-09-08
A software engineer with 20+ years of experience posted a long Reddit question on whether current LLM architecture can achieve AGI. His core argument: autoregressive next-token prediction gives the model no independent mechanism to know when it's wrong; inference doesn't update weights; generation can't backtrack and revise tokens; agent harnesses add what looks like intelligence but are just layered probabilistic systems — like a room of clones playing near-lossless telephone. Humans can backtrack and refine thoughts on their own, while the model's primitive is generation, not explicit reasoning. He asks whether AGI claims on this architecture are smoke and mirrors or whether he's missing something.
More from AGI Musings
- 'Doomer' now covers three very different AI-risk positions, author argues — AndyMasley · 2026-09-08
- AI gains haven't helped artists' economics, sparking calls to rethink art economy — jachiam0 · 2026-09-08
- Agents automate dirty high-leverage work — veterans benefit most, not idea guys — code_star · 2026-09-08
- Alignment May Hinge on One Question: Are Intelligence and Emotion Independent Axes? — MajmudarAdam · 2026-09-08
- "AGI is already here" is one of the worst takes, argues AI commenter — thlarsen · 2026-09-08
- Francois Chollet: no 'AGI' declaration until AI can make inventions and conceptual breakthroughs — Neurogence · 2026-09-08