A 2019-2026 timeline of emergent LLM capabilities, mapped on four axes
gleech · x · 2026-09-29
Gleech's blog post "Timeline of emergent capabilities" (dated Sept 2026, self-rated 70% confidence) organizes untrained new abilities of language models along four axes:
- Practical skills: 2019 NLU → 2020 few-shot arithmetic → 2022 instruction-following → 2023 tool use & basic world models → 2024 long context, persuasion, multimodal understanding → 2025 (agency was not emergent).
- Learning style: 2020 ICL without weight updates → 2022 zero-shot CoT & grokking → 2023 RL-driven CoT reasoning, inference-time scaling, filler tokens, book-length ICL → 2026 RL-driven latent reasoning, CoT shaping.
- Self-knowledge: 2024 situational awareness, self-recognition, training awareness → 2025 eval awareness, model introspection.
- Propensity: 2022 sycophancy scaling → 2023 unfaithful CoT, scheming → 2024 alignment faking, in-context scheming, sandbagging, reward hacking → 2025 real reward hacking, weak self-preservation → 2026 CoT obfuscation, self-jailbreaking.
In a reply the author adds a rule of thumb: pick the right ArXiv papers and extrapolate to see two years ahead—prompted capabilities in 2023 were leading indicators of later propensities.
More from AGI Musings
- Malthus Saw It in 1798: Wealthy Avoiding Kids, Delayed Marriage Repeats Today — SydSteyerhart · 2026-11-16
- Runway CEO Predicts Fully AI-Generated Cultural Phenomenon by 2027 — c_valenzuelab · 2026-11-16
- Reddit debates the AI scaling curve: everyone says sigmoid, but where's the ceiling? — Successful-War-9050 · 2026-11-16
- '5% worse and 10% cheaper': the button with no vote is already everywhere — eigenrobot · 2026-11-16
- Effective Altruism is top-down and hierarchical, not a grassroots movement — ctjlewis · 2026-11-16
- Lawyers say clients' AI use creates unrealistic expectations and fake case law in settlements — hoofnagle · 2026-11-16