Routing experiment results: delegation only pays off in large harnesses

yb2698 · x · 2026-10-23

Results of the small-model routing experiment: with small harnesses like ipython or Pi, the delegation protocol costs more than running the large model directly. Larger harnesses show a gain, suggesting delegation/orchestration makes sense when a very large model is wired into a big harness. Though the small model handles a notable share of turns, it still accounts for a small fraction of output tokens.

Related event: Routing to smaller models can backfire: costs rise 30%-89% in small harnesses(5 posts)→

Original post →

More from coding & agent

coding & agent channel →