Jev, a 'System One' model that only makes decisions, questions how many LLM calls agents really need
ThePromptIndex · reddit · 2026-09-20
A Reddit post examines Jev from TypeSafe AI, a "System One" model that generates nothing — it just makes fast, structured decisions (routing, classification, scoring, yes/no checks).
Key ideas:
- Many LLM calls in current agents only need a label or a yes/no, yet invoke large generative models at high token cost
- A lightweight decision layer can route between agents, classify inputs, filter requests, score outputs, and decide whether an expensive model call is needed at all
- Architecture shifts from "Input → LLM → everything" to invoking large models only when the task requires it
The bigger question raised: how many LLM calls in today's agents actually need to be LLM calls? The author includes a full breakdown with practical examples and caveats — not a replacement for general-purpose LLMs, but an interesting direction of separating decision-making from generation.
More from coding & agent
- Agentic Engineer: Scaling Trust in Your Agents Is the #1 Goal — brandon_galang · 2026-09-20
- Bespoke Labs open-sources Nimble, an open Jev rival for fast typed decisions — RexDouglass · 2026-09-20
- 21M tokens for just $0.76: dev shares eye-popping AI coding bill — aronchick · 2026-09-20
- Compound Engineering adds "bakeoff": agents must build competing approaches before committing — danshipper · 2026-09-20
- Dev Builds Mnemos Cognitive Architecture and a "Retirement Home" for Deprecated AI Models — RileyRalmuto · 2026-09-20
- ChatGPT agent inspected repo, filed 3 GitHub issues and assigned them all to Copilot — dfinke · 2026-09-20