Agent Arena launches leaderboard grading models on millions of real agentic tasks
arena · x · 2026-09-11
Agent Arena launched a leaderboard that measures models on millions of real-world, long-horizon agentic tasks, giving them web search, filesystem and terminal tools to complete workflows like coding, slide decks and app building. It uses causal tracing to measure each model's net improvement over the average, with a Pareto frontier view.
More from coding & agent
- HABIT-Bench: Best agent memory system scores just 33.61% at inferring user habits — SJTU · 2026-10-28
- Regehr's 'Piano Test': would you trust formally verified code with your life? — moyix · 2026-10-28
- Vibe-coded 'AI 浮生记' game satirizes AI startup life with compute black-market trading — vista8 · 2026-10-28
- The legendary fake Go generics: Unicode Canadian Syllabics as angle brackets — rickasaurus · 2026-10-28
- Microsoft Agensh board: a coding agent's "tests passed" is just a message — shoumikgoswami · 2026-10-28
- Ollama and FriendliAI to Host Seoul Meetup on Building Production Agents with Open Models — ollama · 2026-10-28