Transformers' correlation ceiling: external grounding for the missing causal mechanism
gerardsans · x · 2026-10-15
Continuing the discussion on LLM reasoning limits, gerardsans frames the problem as one of external grounding: transformers depend on frozen data manifolds from closed corpora, and their core flaw is reliance on text correlation rather than causal mechanisms — solved only by attaching external systems that provide deterministic computational rules, such as a geometry simulator.
Related event: LLMs Need External Geometry Simulators to Go Beyond Text Correlation(2 posts)→
More from AGI Musings
- Swartzism v0.0.2: packaging Aaron Swartz's access-to-knowledge doctrine for the post-AI era — kingslyj · 2026-10-15
- New essay argues consciousness is a journey living systems do — not AI — AnnaCiaunica · 2026-10-15
- Oversubscribed London AI x Science hackathon maps researchers' biggest software bottlenecks — ersatzben · 2026-10-15
- Hannah Fry: How OpenAI has triggered an existential crisis in mathematics — AnnaCiaunica · 2026-10-15
- Fully-automated combat drones are already on the battlefield, warns Toby Walsh — TobyWalsh · 2026-10-15
- 'They're creating alien minds they can't control? Isn't that regulated?' 'Not really.' — zetalyrae · 2026-10-15