Harness choice alone swings agent speed 3x and cost 10x

Using the same model and identical tasks, a developer found that swapping agent harnesses alone changed end-to-end completion time by 3x and cost by up to 10x.

2026-09-19 ~ 2026-09-19 · 2 related posts

• Harness choice alone drives 10x cost delta: same kimi k3 on identical tbench2.1 tasks — zainhas · 2026-09-19
• Same model, 6 agent harnesses, 3x gap in end-to-end task completion time — zainhas · 2026-09-19