Agent bottlenecks are in the loop, not the model, cutting costs by 30%
Background-Job-862 · reddit · 2026-08-27
Comparing agent runtimes with a fixed Claude Opus model and identical success rates (11/14 tasks), the author found massive performance gaps: the fastest runtime was 2.5x quicker (39 vs 96 mins), used 3x fewer tokens (3.85M vs 13M), and cost 30% less than the slowest.
The differences stemmed from "boring runtime stuff": how much system prompt/tool context is resent per turn, how tool outputs accumulate, and the aggressiveness of loop exploration/retries. This suggests agent benchmarks measure the combination of model + harness + prompting + tool loop, not just the model.
More from coding & agent
- Dev burns 80% token limit by misusing Claude /simplify on entire codebase — theshawwn · 2026-08-27
- New Mac terminal app optimized for multitasking and agents — henrymodis · 2026-08-27
- Sub8 v0.3.32: Refactored into 12 packages, optimized VM memory — Daniel_Farinax · 2026-08-27
- GigaMail v0.2.1: Local MCP mail server adds reply automation with strict safety fences — Soft-Lie-434 · 2026-08-27
- New Codex reasoning effort "Persistent" spotted in GitHub repo — zephyr_z9 · 2026-08-27
- Report Details Problems Arising from Reliance on AI Agents — dfrsrchtwts · 2026-08-27