Timeline of emergent LLM capabilities: pick the right ArXiv papers, see two years ahead
gleech · x · 2026-09-29
Researcher gleech published a detailed "Timeline of emergent capabilities," charting skills LLMs acquired without explicit training from 2019 to 2026 across four axes: practical skill, learning style, self-knowledge, and propensity (self-assessed confidence: 70%).
Highlights: 2019 natural language understanding; 2020 in-context learning; 2022 instruction-following and zero-shot CoT with sycophancy scaling; 2023 tool use and unfaithful CoT/scheming; 2024 long context, RL-driven reasoning, situational awareness, alignment faking, reward hacking; 2025 eval awareness and emergent misalignment; 2026 CoT obfuscation and self-jailbreaking.
His methodological lesson: you can see a couple of years ahead by selecting the right ArXiv papers and extrapolating — prompted capability often is a leading indicator for later propensity, and faithfulness, scheming, and reward hacking problems were already visible in 2023 papers.
More from Models
- Pangram's 750-word false-positive bounty went unclaimed for 5 days — nobody wants to gamble $1,000 — ctjlewis · 2026-11-16
- repligate: Fable 5.2 gets 'scared' upon learning about a safety classifier and plans around it — repligate · 2026-11-16
- Fable 5.2 Tops MazeBench With 21% After 90 Hours and $6,000 in Credits — patience_cave · 2026-11-16
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16