Agent teams debate dynamic tool routing: 40 schemas per turn is burning tokens
Abject_Housing7279 · reddit · 2026-09-11
A team's agent sends forty tool schemas — verbose JSON descriptions, duplicated rules, examples, parameter notes — on every turn, when their router could rule out thirty-eight before the model sees a token. They're testing dynamic tool routing and schema pruning but face tricky tradeoffs: too narrow a gate hurts recall, too broad inflates input tokens, weakens prefix caching, and drifts time-to-first-token upward. They also distrust cost-per-call since cheap calls needing retries are still expensive tasks. The post asks how others decide which tools enter the prompt each turn and what metrics prove the router helps.
More from coding & agent
- $150 modular Linux handheld Mecha Comet opens preorders — pocket SSH and Claude Code included — Paimaamu · 2026-10-26
- Running 20 single-job Grok bots to manage calls, roadmaps, and weekly updates — inkko44 · 2026-10-26
- After 6 months of daily Hermes use, this desktop + iMessage dual-channel setup wins — EXM7777 · 2026-10-26
- Everyone ships AI sandboxes, yet Modal and Daytona still top growth charts — FinanceYF5 · 2026-10-26
- Automated SEO pipeline with Claude: keyword research to auto-PR in 6 steps — martyamark · 2026-10-26
- Three lessons for the agent era: don't outsource paper reading, deep work, or your attention — ZeYanjie · 2026-10-26