Agent Arena Launches Agent Leaderboard Ranking 46 Models on 2M+ Real-World Sessions
arena · x · 2026-09-29
Agent Arena has launched a performance leaderboard that measures how well AI models orchestrate tools on real-world, long-horizon tasks using web, filesystem, and terminal tools, based on over 2 million sessions across 46 models.
Key takeaways
- Claude Fable 5.1 (Max) tops the board with 14.06% net improvement and 17.37% confirmed success rate
- Claude Opus 5.5 (High) ranks second (11.84%) at a notably low median cost of $1.33 per task
- GPT 6 Astra (Max) takes third (10.36%) with the highest praise-vs-complaint ratio (33.92%)
- Anthropic models dominate the top 10; per-task costs range roughly from $0.81 to $3.47
Metrics include tool reliability, steerability, bash recovery, and tool hallucination rate, making it a practical reference for choosing agent models.
More from Models
- Sarvam Token Factory goes GA, offering open models for enterprise workflows — itsOmSarraf_ · 2026-11-16
- Pangram's 750-word false-positive bounty went unclaimed for 5 days — nobody wants to gamble $1,000 — ctjlewis · 2026-11-16
- Fable 5.2 Tops MazeBench With 21% After 90 Hours and $6,000 in Credits — patience_cave · 2026-11-16
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16