Jev, the Text-Free 'System One' Model: 200x Faster, ~400x Cheaper Than LLM Workflows
AI寒武纪 · wechat · 2026-09-22
Jev from TypeSafe AI has gone viral among developers and is now generally available. It's a "System One" semantic decision engine with no text-generation ability: given a state and typed questions, it returns strongly-typed choices with calibrated confidence — engineers call it "a switch statement with semantic understanding."
Key facts:
- Three output types: Choice (option + probability distribution), Score (ordinal levels), Noul (boolean probability). Output never violates the schema.
- Pricing: $0.042 per million input tokens, output free; 70–500ms latency; official benchmarks show 200x faster execution and 400x lower cost vs. generative-LLM workflows.
- Trained with RLCD (reinforcement learning from calibrated decisions): a stated 90% probability converges to 90% real accuracy. "No hallucination" only guarantees format compliance — the judgment itself can still be wrong.
- Best-fit uses: model routing, tool-call risk gating for agents (e.g., flagging destructive shell commands), and verification of agent outputs. Not for open-ended generation, deterministic computation, or long-chain reasoning.
- Adoption advice: replace your most brittle regex rule or a wasteful yes/no LLM call first, run in shadow mode to calibrate confidence thresholds, then switch traffic. Sign-up includes $5 credit (120M input tokens).
More from coding & agent
- Jay Alammar's 'Illustrated Guide to AI Agents' ships print copies October 6 — JayAlammar · 2026-09-23
- Shopify CEO's "slop grenades": 52.7% of workers admit sending unread AI output — max_gladysh · 2026-09-23
- Rails agent evals: OpenAI stays ahead, Luna Max the dark horse at 18% completion for just $11 — npew · 2026-09-23
- Agent regression testing benchmark: embeddings caught only 7/19 real answer changes — redhatpanda07 · 2026-09-23
- Three years of formal validation: AI now writes the Rust and proves it in Lean — carlk22 · 2026-09-23
- Sales and marketing MCP servers grouped by job, with pricing checked from vendor pages — CartographerLife725 · 2026-09-23