Tool Count Doesn't Predict Agent Gains: Correlation Is Just −0.15

yb2698 · x · 2026-10-24

In a follow-up to the harness2 reproduction thread, the author shows tool count doesn't predict gains: correlation between tools added and runs gained is −0.15. floor-plan got 3 tools and a 452-word prompt yet lost 5 runs; protein-sequence gained 7 runs from just 1 tool. The right tool matters, not the number.

Related event: Reproducing Google's harness2: Qwen3-9B pass rate jumps from 31% to 45%(6 posts)→

Original post →

More from coding & agent

coding & agent channel →