Open-source Routed routes Agent Skills in under 20ms with zero tokens, fully offline on CPU
iAmQubick · reddit · 2026-09-07
A developer released Routed, an MIT-licensed local-first router for agent skills, addressing the trade-off between stuffing every skill into the system prompt (context bloat) and paying for an LLM router turn (1,000+ tokens, 2+ seconds latency).
How it works: a 4-part hybrid scoring pipeline — quantized ONNX embeddings (60%, Arctic Embed S / MiniLM) + Okapi BM25 (25%) + exact/alias match (10%) + metadata (5%) — completes lookups in under 20ms entirely on CPU with no prompt data leaving the machine.
Environments: auto-detects and injects adapters for Cursor, Claude Code, LM Studio, Ollama, Windsurf, OpenCode, Continue, Codex and more; trigger skills with /route, with compound-intent support.
v1.1.0 adds an MCP server mode (model sees one routeskill tool, schemas injected on demand) and native multilingual understanding across 100+ languages. Pre-built binaries available for macOS, Linux and Windows.
Related event: Open-Source Routed Handles Agent Skill Routing on CPU in 20ms, Zero Tokens(2 posts)→
More from coding & agent
- Swarms ships v15 "Akira" with dynamic tool loading and rebuilt multi-agent execution — KyeGomezB · 2026-09-07
- Delegation tax: every agent handoff adds variability — use big models when it matters — brandon_galang · 2026-09-07
- RootCrak launches Preflight: AI agents pay per scan via x402 for pre-connection security checks — Thionne_WTZ · 2026-09-07
- MathKernel MCP ships 160+ math tools with trust labels so models can't fake proofs — Staatsgeheim_ · 2026-09-07
- Mux and Resend launch email-responder hackathon with all-in trip to Resend Forward — philnash · 2026-09-07
- dingcad adds modeling APIs, generates ductwork straight from LLM — yacineMTB · 2026-09-07