Grady Booch: transformer LLMs remain non-deterministic statistical engines at their core
Grady_Booch · x · 2026-09-22
Grady Booch argues that the architecture of every transformer-based LLM yields next-token prediction. Symbolic harnesses surrounding an LLM soften those sharp edges, but at the core they remain non-deterministic, statistical engines walking through a large static multi-dimensional manifold.
More from AGI Musings
- Toby Ord on swarm scaling: 10,000-agent run cost ~$20M, solved Navier-Stokes in 88 hours — tobyordoxford · 2026-09-22
- Krueger: "indefinite" AI moratorium doesn't mean permanent — DavidSKrueger · 2026-09-22
- Toby Ord: Agent Swarm Estimates Put Intelligence Explosion Parameter λ at 0.5-0.6 — tobyordoxford · 2026-09-22
- Why did Altman, Amodei and Musk suddenly agree on pacing frontier AI within two weeks? — k1_r1 · 2026-09-22
- Agent swarm data suggests intelligence explosion parameter λ around 0.5-0.6, below threshold — tobyordoxford · 2026-09-22
- Amazon blocks Muse: platforms brace for an agent-mediated power struggle — tobowers · 2026-09-22