Harness choice alone drives 10x cost delta: same kimi k3 on identical tbench2.1 tasks
zainhas · x · 2026-09-19
Using the exact same solvable tbench2.1 tasks and the same model (kimi k3) across 5 different harnesses, the author found harness choice alone produced a 10x cost delta. Full analysis coming soon — a strong reminder that the orchestration layer, not just the model, determines agent costs.
Related event: Harness choice alone swings agent speed 3x and cost 10x(2 posts)→
More from coding & agent
- Veteran game dev: "AI builds a full game in a day" posts are mostly hype — bendee983 · 2026-11-04
- Dev builds interactive Excel-to-dashboard with ChatGPT, shares the prompt — TermRemarkable665 · 2026-11-04
- Agents cut dev time from weeks to a day; bottleneck moved to specs and review — Suspicious_Orchid770 · 2026-11-04
- Orgo, a YC-backed platform giving AI agents their own cloud desktops, claims 1,000+ teams — Scobleizer · 2026-11-04
- Founder: Vibe-coded a PMF-successful product, then hired pro devs to fix the mess — sujingshen · 2026-11-04
- One prompt to audit cross-region traffic: dev cut trans-Atlantic latency by moving a service — DanielLockyer · 2026-11-04