'Emergence' is just conditioned inference, not real capability, argues dev
gerardsans · x · 2026-09-29
In a debate with @gleech and @gwern, Gerard Sans argues that so-called emergent LLM abilities are really just "compression of co-occurring text patterns": feed a model enough cat pixels and it reproduces cat pixels — conditioned inference, not emergence. He says labelling outputs as emergent is an external mechanism living in our imagination, not in the training data, transformer, or inference — just as primes don't prove emergence in natural numbers.
Related event: Debate Reignites Over Whether LLM Emergent Abilities Are Real or Illusory(3 posts)→
More from AGI Musings
- Malthus Saw It in 1798: Wealthy Avoiding Kids, Delayed Marriage Repeats Today — SydSteyerhart · 2026-11-16
- Runway CEO Predicts Fully AI-Generated Cultural Phenomenon by 2027 — c_valenzuelab · 2026-11-16
- Reddit debates the AI scaling curve: everyone says sigmoid, but where's the ceiling? — Successful-War-9050 · 2026-11-16
- '5% worse and 10% cheaper': the button with no vote is already everywhere — eigenrobot · 2026-11-16
- Effective Altruism is top-down and hierarchical, not a grassroots movement — ctjlewis · 2026-11-16
- Lawyers say clients' AI use creates unrealistic expectations and fake case law in settlements — hoofnagle · 2026-11-16