Agent teams debate dynamic tool routing: 40 schemas per turn is burning tokens
Abject_Housing7279 · reddit · 2026-09-11
A team's agent sends forty tool schemas — verbose JSON descriptions, duplicated rules, examples, parameter notes — on every turn, when their router could rule out thirty-eight before the model sees a token. They're testing dynamic tool routing and schema pruning but face tricky tradeoffs: too narrow a gate hurts recall, too broad inflates input tokens, weakens prefix caching, and drifts time-to-first-token upward. They also distrust cost-per-call since cheap calls needing retries are still expensive tasks. The post asks how others decide which tools enter the prompt each turn and what metrics prove the router helps.
More from coding & agent
- Claude Code 2.1.268 Ships 96 Changes With Gateway Security Warnings — ClaudeCodeLog · 2026-09-11
- Open-source real-time poker coach demo built on GPT-live-1, cards and UI generated on the fly — pbbakkum · 2026-09-11
- FindWeedNY launches a public MCP server feeding fresh NY cannabis data to AI chatbots — FindWeedNY · 2026-09-11
- Heurist Finance lets AI agents pay for data via AWS AgentCore, x402 and USDC on Base — builderjaydub · 2026-09-11
- Grok Build ships three releases in one day: /btw side questions bypass the main transcript — XFreeze · 2026-09-11
- LiveKit adds OpenAI GPT-Live: full-duplex voice model that listens and speaks at once — OpenAIDevs · 2026-09-11