SemiAnalysis Open Sources $3M AgentX Benchmark for Agentic Coding Workloads
AccBalanced · x · 2026-08-24
SemiAnalysis released AgentX 1.0, the first open-source, multi-turn agentic coding inference benchmark at 1 million context, built with over $3M.
It addresses the inaccuracy of traditional fixed-sequence benchmarks by modeling realistic agentic workflows: multi-turn, long context, high prefill reuse, and sub-agent bursts. The test matrix spans 2MW of compute across chips like GB300 NVL72, MI355, and B200.
Related event: SemiAnalysis Open-Sources $3M AgentX Benchmark for AI Coding Agents(2 posts)→
More from coding & agent
- Self Labs launches Agent Vault to let AI agents log in and pay with credit cards — EXM7777 · 2026-10-16
- XERJ hits #1 on GitHub Trending, claims 40x token savings vs grep for AI agents — alexcovo_eth · 2026-10-16
- Plane Agents: triggers, not prompts, are what turn chatbots into workflow agents — JosephJacks_ · 2026-10-16
- Claude eng lead Felix Rieseberg publishes tutorial on being more ambitious with AI — danshipper · 2026-10-16
- Qwen Code Desktop v0.25.2 ships managed-agent fixes and MCP config repair — github-actions[bot] · 2026-10-16
- NVIDIA makes 7 AI agent courses free, from agent basics to securing agents — ifioknkem · 2026-10-16