Grady Booch insists transformer LLMs are next-token predictors at their core
Grady_Booch · x · 2026-09-23
- Grady Booch doubles down in an ongoing debate: every transformer-based LLM is, by architecture, a next-token predictor, a claim he calls demonstrable.
- He concedes most contemporary AI systems wrap symbolic harnesses around LLMs, making the whole system more than token prediction — but the core claim stands.
- He presses his interlocutor for common ground: do you agree transformer LLMs are next-token predictors at their core?
Related event: OpenAI's Navier-Stokes Proof Ignites Fierce Debate in Math and AI Circles(20 posts)→
More from AGI Musings
- Functionalists point to MoE vs dense models to argue brain compute debate — JoshPurtell · 2026-10-06
- Rob LeClerc backs the case that AI could let humanity retake bigger risks thoughtfully — robleclerc · 2026-10-06
- iamtrask boosts token-attribution idea to fix enterprise AI's incentive misalignment — iamtrask · 2026-10-06
- AI Systems Aren't P-Zombies, and the Term Mismatch Matters — rgblong · 2026-10-06
- AI systems are not p-zombies in the philosophical sense, explains Robert Long — rgblong · 2026-10-06
- Brad Neuberg: I want a human-shaped future with AI, not AIs 'spinning through the void' — bradneuberg · 2026-10-06