Opinion: many LLM limits are limits of natural language itself, not scale
fkasummer · x · 2026-10-21
The author argues that many limitations of language models are in fact limitations of natural language itself — no amount of scaling can overcome that — implying breakthroughs may require other forms of representation beyond text.
More from AGI Musings
- Grady Booch: Computing's Journey Remarkable for Making Us Ask About AI Consciousness — Grady_Booch · 2026-10-21
- "Don't want kids" is a measurement error, not a preference, argues AI-circle KOL — l4rz · 2026-10-21
- Halvar Flake: AI made competent code auditing cheap — expect a wave of long-buried bugs — basedjensen · 2026-10-21
- Balaji: the original ASI was capitalism itself, not AI — beffjezos · 2026-10-21
- Founder jokes: every loss-making Indian startup now looks like an RL environment to me — HarveenChadha · 2026-10-21
- swyx: AI compute is supply-constrained — more tokens means more revenue, not lower prices — swyx · 2026-10-21