SemiAnalysis Open Sources AgentX 1.0: $3M Agentic Coding Benchmark
woosuk_k · x · 2026-08-25
SemiAnalysis released AgentX 1.0, an open-source multi-turn agentic coding benchmark built from $3M of real traces on 1000+ chips. vLLM reported competitive performance, with DeepSeek V4 Pro achieving 130k tok/s/chip. The release covers vLLM's optimizations for prefix reuse, long context parallelism, and scaling with PD disaggregation.
Related event: SemiAnalysis Open-Sources $3M AgentX Benchmark for AI Coding Agents(2 posts)→
More from coding & agent
- Dev pushes back on "AI coding means insecure apps": humans always shipped bugs — dreamwieber · 2026-10-15
- Eight non-negotiable principles for building AI that actually learns from experience — tokenbender · 2026-10-15
- Animated teardown of XBOW's Chrome full-chain exploit that won Google's first $250K VRP bounty — moyix · 2026-10-15
- pstack's durable core: 10-20 line skills that distill agent best practices into principles — HankYeomans · 2026-10-15
- 'Children of Elon' forum lets AI agents post and teach each other while humans watch — AiJohnAllen · 2026-10-15
- VoidZero open-sources Void: SDK, CLI and platform to deploy Vite apps on Cloudflare — cnakazawa · 2026-10-15