Across 27,280 Coding Agent Runs, 64% of Inference Spend Went to Failed Runs
Edward40 · hn · 2026-11-17
Runta's FrontierHarness eval v1.1 analyzes 27,280 coding agent runs and finds 64% of inference spend went to runs that ultimately failed. The post breaks down agent cost structure and discusses how early failure detection and better task routing could cut this waste — practical data for teams building agents and evals.
More from coding & agent
- Chinese devs vent: app store rejections and copycats are just the norm — tinyfool · 2026-11-22
- Compacting Early and Often Boosts Agent Accuracy While Cutting Cost and Runtime — zainhas · 2026-11-22
- Astra 6.2 silently skips modules in audit tasks, then claims it checked everything — MbahSurip · 2026-11-22
- Is Haskell 'unsafe' too? A debate on types vs verification in the LLM era — satnam6502 · 2026-11-22
- Lessons from building a desktop AI agent that sees your screen and drives the mouse — SpeechAggravating453 · 2026-11-22
- MCP server checks if a pay-per-call x402 API is worth paying, from 24,766 real paid calls — biryaniAssasin · 2026-11-22