How Jev works: teardown of TypeSafe's typed decision model, replicated on open Qwen models
vykthur · x · 2026-09-25
Victor Dibia published a deep teardown of TypeSafe AI's Jev, a 'System One' decision model that outputs typed, probabilistic decisions instead of text, claiming 70-500ms latency and so-cheap inference that output tokens aren't metered.
- How it works: Jev turns a decision task into a completion prompt — a state plus a list of options, with the prompt ending exactly where the answer goes — returning typed decisions with probabilities rather than free-form text.
- Hands-on experiments: The author replicated the approach on open Qwen models to test whether completion-style prompting works for classification-style decisions.
- Tradeoffs covered: architecture differences vs. autoregressive models, when to use it, and what you give up (generative capability) for low latency and cost.
He also experiments with an interactive-explainer format for his articles, hosted on his own site.
Related event: TypeSafe's Jev Becomes Fastest-Adopted AI Model, Sparking Agent Ecosystem(4 posts)→
More from coding & agent
- Pose Blueprint: A Browser-Based 3D Pose Editor for ComfyUI and ControlNet — OkConfusion6667 · 2026-09-25
- DigitalOcean hosts classifier model Jev as a first-class agent tool, not an endpoint — hardimanjames · 2026-09-25
- The wiki is an anti-pattern: docs must live in the repo for coding agents to maintain — TechPreacher · 2026-09-25
- Caching policy lookups per inode cuts eBPF security agent CPU cost ~90% — JeremyCMorgan · 2026-09-25
- jev-test-impact uses an LLM to pick which tests to run from a Git diff — alchemist-301 · 2026-09-25
- Astronomer builds his dream learning tool in ~5 hours with Opus 5.5, now live — niloofar_mire · 2026-09-25