Agent Arena Index launches: ~3M real-world agentic sessions benchmark agent performance
infwinston · x · 2026-11-19
Agent Arena Index is now live, built on nearly 3M real-world agentic sessions to measure how well agents get real work done. Six new sub-indexes cover knowledge work, coding, task completion, tool use, and steerability — premised on the idea that the real world is the ultimate benchmark for intelligence.
Related event: Arena Launches Agent Arena Index Built on 2.9M Real Sessions(8 posts)→
More from Research
- DaisyRose-27B: RL on 144 H200s for 18 days lifts Terminal-Bench from 5.6% to 12.0% — ying11231 · 2026-11-19
- After a fix, MuonM edges out Muon while MuonS performs about the same — YouJiacheng · 2026-11-19
- GPT 5.6 Sol, released just 4 months ago, can no longer reliably monitor frontier models — connoraxiotes · 2026-11-19
- Ambient SFT: treating the pre-finetune model as a noisy teacher, up to 21% gains — giannis_daras · 2026-11-19
- SREGym 2.0 recreates the Microsoft Outlook outage: a latent gateway bug plus cascading failures frontier AI can't yet solve — ajratner · 2026-11-19
- 'Naturals + infinity' form a nonstandard model of Robinson arithmetic — jessi_cata · 2026-11-19