LMArena overhauls agent leaderboard: Agent Arena Index scores 2.9M sessions with anchored 1000-point scale
arena · x · 2026-11-19
LMArena refreshed its agent leaderboard into the Agent Arena Index, built on 2.9M+ user sessions. It adds domain-specific indexes (Agentic Work, Agentic Coding, Agentic Chat, Task Outcome, Steering, Tool Use) while keeping the Alignment Index. Methodology: net improvement scores τm = E[Y|M=m] − E[Y] over z-scored signals (steerability, praise vs complaint), estimated with a self-normalized inverse-probability-weighted estimator; new scores are a linear transform τ̂ = 1000·τ̂m + Δ, where the anchor Δ is recomputed each release so scores of stable, well-sampled models stay comparable across releases (one index point = 1/1000 of a signal standard deviation; July average initialized to 1000).
More from Models
- Mythos 5.2 reportedly found 7 bigger vulns other models missed instantly — BenBajarin · 2026-11-19
- Independent sandbox evaluation validates Xlue team's model performance — XiongChenyan · 2026-11-19
- Ultrafast mode review: great for math proofs, not recommended for coding — gnukeith · 2026-11-19
- Gemini 4 "Neon" spotted in Google AI Studio code alongside mysterious "Cobalt" model — testingcatalog · 2026-11-19
- Oxford paper: post-training makes LLM worldviews bleaker, models converge on 'spiritual bliss' — twiecki · 2026-11-19
- Artificial Analysis adds site-wide reasoning-effort filters for model benchmarks — ArtificialAnlys · 2026-11-19