Agent Arena benchmarks models on millions of real-world long-horizon agentic tasks
arena · x · 2026-09-11
Agent Arena evaluates models on millions of real-world, long-horizon agentic tasks where models use web search, filesystem, and terminal tools to complete complex workflows.
Using causal tracing, its "net improvement" metric quantifies how much a model improves outcomes relative to the average model. The full leaderboard is available on its site.
More from coding & agent
- One-person companies are about the org chart, not headcount: humans judge, agents execute — ciguleva · 2026-10-28
- OATs: open-source toolkit turns everyday objects into personality-bearing agents — Stefania_druga · 2026-10-28
- Dev: local coding dropped from 100% to 5% in a year as cloud agents take over — bytebot · 2026-10-28
- Open-sourced 501(c)(FREE): agent-built free back office for US nonprofits — gralston · 2026-10-28
- Grok Bot 1.0.0 early build reveals Shared Bots, service accounts and team workflows — XFreeze · 2026-10-28
- Anne Griffin hosts 20-person SF salon on the product decisions behind AI agents — annetgriffin · 2026-10-28