DeepSeek Harness team's agent design draws praise for batching: per-decision inference cost falls to 1.6s

teortaxesTex · x · 2026-11-01

teortaxesTex commented on the DeepSeek Harness team's published team-agent design: a solid but expected design, not yet paper material, not better than Dot and similar efforts—but the repo itself is interesting and he expects interesting results to grow out of it.

The attached figures detail the Router layer's batching: as decision-trigger arrival rate rises from 1 to 40 events/minute, average batch size grows from 1.0 to 2.8 while time per request only rises from 2.5s to 3.9s, so inference time amortized per decision drops from 6.4s to 1.6s. When bursts create a backlog, the Router combines queued events for higher effective throughput, and at current team size there's no need to partition the Router layer prematurely at the cost of global context continuity.

Related event: DeepSeek Harness Unveils Super-agent Design and Open-Source Prototype(9 posts)→

Original post →

More from coding & agent

coding & agent channel →