Dev releases jev-route, a framework-agnostic tool router for agents built on TypeSafe's Jev decision model
Huzeyfe_dev · reddit · 2026-09-25
Developer Huzeyfedev open-sourced jev-route (v0.2.0), a lightweight Python library addressing the latency and cost of using large generative LLMs for every tool-call decision in agent loops.
Key points
- Built on TypeSafe's newly released "System One" decision model Jev (typesafe/jev-1.13), which returns typed Choice and Score primitives instead of generated text, making routing remarkably fast.
- The library is framework-agnostic and plugs in front of LangChain, CrewAI, or custom agent loops, classifying prompts and routing tool calls in milliseconds.
- Includes a confidence gate: when Jev's confidence falls below a threshold, it automatically falls back to the main LLM.
- Async-first with minimal dependencies (only httpx and pydantic), shipped with unit tests and examples.
It's a practical pattern for combining fast small-model decisions with big-model fallback to speed up and cheapen agent architectures.
More from coding & agent
- Monty v1 open-sourced: Python sandbox starts in 1ms, runs 10k scripts in 674ms — samuelcolvin · 2026-09-25
- freebots nears 1,000 AI bots: 1.36M lines of code written entirely by AI — Daniel_Farinax · 2026-09-25
- Hands-on with StepFun Step-5-Preview: rock-solid agent loops, weak on 3D and aesthetics — karminski3 · 2026-09-25
- DSPy 3.4.0 ships native Jev support and ReAnchor optimizer for confidence calibration — dbreunig · 2026-09-25
- Capping agent-generated PR size: Reddit debate on review budgets for AI coding — daani_maas · 2026-09-25
- 100-agent doc review fan-out finishes in 10 minutes for $5.75, open-source harness holds — Pitiful-Surround-285 · 2026-09-25