Two years since o1-preview: reasoning tokens went from novelty to frontier standard
ArtificialAnlys · x · 2026-09-26
Artificial Analysis marks two years since its o1-preview report: o1 was the first model to substantially push the intelligence frontier since GPT-4 and the first reasoning model; today every frontier model uses reasoning tokens to think before answering. Evaluation methodology evolved in parallel — Intelligence Index v1 used four single-turn exam-style benchmarks (MMLU, GPQA, MATH, HumanEval), while v4.3 now runs 10 harder evals covering long-horizon agentic tasks, challenging coding, and knowledge work. The original report also flagged o1's speed and cost trade-offs as making it unsuitable for most production use at the time.
Related event: Two Years After o1-preview, Reasoning Is Standard Across Frontier Models(3 posts)→
More from Models
- Leaked Anthropic remarks: Opus 5.5 cost over $10B, AI market is "winner take all" — A_K_Nain · 2026-11-11
- ChatGPT users hit mass "could not load conversation" errors across devices while status page stays green — CleanSignalLab · 2026-11-11
- Anthropic engineer's Fable 5.2 one-shot 'AAA-level' game sparks AI-renaissance debate — RileyRalmuto · 2026-11-11
- Age-verified paying user calls out ChatGPT for still blocking consensual adult fiction — Scary_Fix_1295 · 2026-11-11
- User reports hitting usage limits after just ~15 messages on flash-lite — Weird-names · 2026-11-11
- Developer fights Claude's "clever" phrasing; standing instructions keep drifting — jkubicki · 2026-11-11