Claude Code Costs 3.7x More Than Open-Source Agents in Task Benchmark
Teknium · x · 2026-08-01
Composio released a cost comparison test for mainstream coding agents. Hermes Agent and Pi Agent lead on the lowest average cost per task at $0.39 and $0.40 respectively, while Claude Code is the most expensive at $1.47—about 3.7x higher.
The median cost tells the same story ($0.29 for Pi/Hermes vs. $0.72 for Claude Code), indicating the gap holds for typical tasks and isn't driven by a few expensive runs. Costs were calculated using Kimi K3’s list prices: $3/1M input tokens, $0.30/1M cached input tokens, and $15/1M output tokens.
More from coding & agent
- Comparison: Opus 5 vs Fable 5 Generating Three.js Volcano — majidmanzarpour · 2026-08-01
- Developer praises Amp coding tool for delivering insane value — bytebot · 2026-08-01
- Open-source kdbx tool lets AI agents use secrets without leaking them — nabsha · 2026-08-01
- Surveying AI Agent Eval Practices: Real-Time Monitoring and Action Blocking — CFGeek · 2026-08-01
- Agent Workflow Tip: Automating QA Checks with Nested Loops — EricBuess · 2026-08-01
- Building AI Agents: Evals and 'agents that debug agents' are equally crucial — andreisavu · 2026-08-01