NVIDIA Open-Sources NeMo Switchyard for Dynamic AI Agent Routing
Sam Witteveen · youtube · 2026-08-11
NVIDIA released NeMo Switchyard, a new open-source library designed to dynamically route AI agent workloads across the most suitable models for each step of a run.
The tool supports routing decisions based on request signals, agent state, tool results, and model capabilities, cost, and latency. It offers various routing algorithms, including LLM classifiers, cascade routing, and trainable prefill routers. With built-in observability, it helps developers keep routine tasks on efficient models while switching to frontier models when necessary, bringing specialized, local, and frontier models together within a single agentic system.
Related event: NVIDIA Unveils Nemotron 3.5 Lightning and NeMo Switchyard Router(55 posts)→
More from coding & agent
- Meta open-sources Muse Spark Open agent model with day-0 TPU support in SGLang — BanghuaZ · 2026-10-16
- Saying "load-bearing" in your prompt makes Opus 5.5 stop holding back — zacharynado · 2026-10-16
- You.com partners with Paperclip to give every agent live web access — PolarBearby · 2026-10-16
- I priced every Grok Bot call: $20 to $200 plan in 5 days, long jobs eat 52% — jonathanmalkin · 2026-10-16
- GitHub is criminally underrated as a free data store, devs argue — blelbach · 2026-10-16
- Claude Desktop doesn't support MCP sampling — here's a workaround for two-way MCP apps — wuj · 2026-10-16