Arena: coding-agent harnesses show up to 5x cost differences at similar success rates
thione · x · 2026-09-21
Arena's comparison of coding-agent harnesses across 21 model-harness combinations found that harnesses can produce similar success rates at up to 5x different costs.
The takeaway: the agent harness itself is a major cost-efficiency variable — the same model with different orchestration can score comparably while costing wildly different amounts, with direct implications for coding-agent selection and cost budgeting.
More from coding & agent
- Grok Bots 1.0 leaks: multiplayer teammates, proactive agents in Slack and Teams — XFreeze · 2026-11-12
- Could MCP-powered copy-trading disrupt ETFs? Investor floats paying 0.5% for trade signals — MartinGTobias · 2026-11-12
- minpts-check: one-run predictor tells if your HDBSCAN clusters survive min_samples changes — leland_mcinnes · 2026-11-12
- Ten wild Gemini 4 Carbon demos in 24 hours: CUDA meadows, V8 engines, mech stomps — socialwithaayan · 2026-11-12
- How to cut Fable 5.2 token costs by 90%: Arc routing plus a lean CLAUDE.md — EXM7777 · 2026-11-12
- Hamel Husain's complete AI evals framework for PMs and engineers — aakashgupta · 2026-11-12