Base Labs Open-Sources joey-1, a 2B Decision Model With 20ms Latency at a Penny per M Tokens
baseten · x · 2026-10-30
Baseten open-sourced its third decision model, joey-1 (2B), optimized for speed and cost: P50 end-to-end latency of 20ms on a typical 2,000-token request (2.5x faster than elephant-1), at $0.01 per million tokens — a tenth of mammoth-1's price.
Decision models skip text generation and directly answer questions like "where should this ticket go?" or "should this request be approved?" with a single token plus a calibrated probability, slashing cost and latency across chained decisions. joey-1 accepts text and images, is available via Baseten's Model APIs and dedicated deployments, and ships with a fine-tuning cookbook. Internal tests claim it's the strongest decision model at ≤3B parameters.
More from Models
- Hugging Face's Carbon-X: 14B open model with 300B DNA tokens rivals GPT 6.1 Sol — evijit · 2026-10-30
- Gemini 4 Carbon is maybe the best model on paper, but Redditors aren't convinced — tjrobertson-seo · 2026-10-30
- User complains Claude Opus has too much "ego", ignores instructions — letandrewcook · 2026-10-30
- Screenshot appears to show GPT-6 as a selectable model in ChatGPT app settings — manosaie · 2026-10-30
- Claude's audit of an economics book holds up, says economist Bryan Caplan — sebkrier · 2026-10-30
- Claude Swarms Built Democracies, GPT Swarms Built Hives — GPTs Won 6-1 — ycombinator · 2026-10-30