Agent cost benchmark on 114 tasks: money goes to retrieval, not reasoning
Coworker_ai · reddit · 2026-09-04
The Coworker team ran 114 tasks with and without a memory layer in front of Claude, same agent and prompts:
- 66% overall cost reduction; 89% cheaper on Jira/GitHub/Slack lookup tasks
- Surprise: expected wins on hard reasoning tasks, actual wins on retrieval-heavy tasks
- Key insight: agents re-derive yesterday's query every run; nobody splits retrieval spend from reasoning spend, so it just inflates the bill
Takeaway: memory/caching layers pay off primarily by cutting repeated retrieval, not reasoning.
Related event: Memory Layer Cuts Agent Costs 66% Across 114-Task Benchmark(2 posts)→
More from coding & agent
- Claude Code self-hosted environments enter public beta — EricBuess · 2026-09-04
- Compared 6 AI Visibility Tools: $199 Ahrefs Actually Costs $974/Mo at Scale — Informal-Dust4499 · 2026-09-04
- AI agent River cleared 70% of vuln backlog in 11 days, merge rate 10% to 80% — jevon · 2026-09-04
- Databricks found $1.2M/year in wasted AI spend from 7 MCP-server bugs — matei_zaharia · 2026-09-04
- Open-sourced: training code for a mobile screenshot classifier (feeds, gallery, chats) — TheMoonMidas · 2026-09-04
- Model routing cuts LLM errors 46% at same cost, Martian study finds — SucceededMind · 2026-09-04