Laya: Open-Weight System 1 Decision Model Answers in 33ms per Pass
Balance- · reddit · 2026-09-21
Convai Innovations released Laya, an Apache 2.0 'System 1' decision model and open alternative to TypeSafe's closed Jev API. Instead of generating text, it takes a state (text, email, ticket, or JSON) plus typed questions (choice, score, noul) and answers all in one forward pass in 33–40ms on GPU — no parsing, nothing to hallucinate.
- Three checkpoints: a 421M English model on ModernBERT-large, a faster 322M multilingual model on mmBERT-base covering 100+ languages, and a typed-decisions-tuned variant, with a built-in Router detecting input script.
- Trained with RLCD using strictly proper scoring rules so honest probabilities maximize reward; includes an act-vs-escalate head for human handoff.
- Author reports beating Jev on AG News, emotion classification, and typed-decisions while running 6–8× faster (Jev figures are third-party numbers).
- Candid limits: near-chance without fine-tuning on typed-decisions; sharp drops beyond 50 options (Banking77: 0.425 vs Jev's 0.870); ordinal scoring weakest; fails on non-Latin scripts; ships overconfident — fit a temperature on your own data first.
Related event: Open-Source Decision Model Laya Delivers Judgments in 33ms(2 posts)→
More from Models
- OpenAI's $200 plan burns 33% in 48 hours; user calls it a bait and switch — AIandDesign · 2026-09-21
- DeepSeek Web Output Style Reportedly Lobotomized by Safe Harbor RLHF — Old_Let6328 · 2026-09-21
- JEV opens to all with $5 free credits; $0.042 input and free output pricing — op7418 · 2026-09-21
- Inception CEO Stefano Ermon bets on diffusion LLMs that generate tokens in parallel — saranormous · 2026-09-21
- Testing decision model Jev: add "none of these" options and never do algebra across questions — colinmcnamara · 2026-09-21
- Jev's calibration error measured at ~0.09: right just as often, still off about how sure — colinmcnamara · 2026-09-21