Same model, 6 agent harnesses, 3x gap in end-to-end task completion time
zainhas · x · 2026-09-19
- Running the same 12 Terminal Bench 2.1 tasks (all solved/saturated) with the same model (Kimi K3) across 6 different agent harnesses produced a 3x difference in end-to-end completion time.
- The takeaway: harness engineering alone can dominate agent efficiency, so framework choice matters as much as model choice.
Related event: Harness choice alone swings agent speed 3x and cost 10x(2 posts)→
More from coding & agent
- Hindsight ships 0.8B model for agent memory decisions: 2.5x cheaper, 1.9x faster — victor_explore · 2026-11-04
- Human Oversight Is 70-75% of AI Agent Costs in Banking, McKinsey Finds — mikeflache · 2026-11-04
- Over 80% of Major Financial Institutions Now Run Agentic AI in Production — mikeflache · 2026-11-04
- Mnemos MCP nears launch after shared memory layer fix — RileyRalmuto · 2026-11-04
- Moving mobile dev to remote machines makes it multiplayer across product, design, engineering — rudrank · 2026-11-04
- Kuaishou's EvoRec: self-evolving agentic recommender lifts ad revenue 4.6% — _reachsumit · 2026-11-04