421M-parameter open-source Laya returns answer probabilities in one pass at 40ms on a T4
maier_ak · x · 2026-09-28
Laya is a 421M-parameter open-source model (Apache 2.0) built by a solo developer: it takes text plus typed questions and returns answers with probabilities in a single forward pass—no text generation at all—running at 40 ms on one T4 GPU.
Its closed counterpart, Jev from TypeSafe AI, is API-only at $0.042 per million input tokens. Independent benchmarks put Jev at 264-276 ms median latency, 0.910 on AG News, and a calibration error of 0.246—the worst in that study.
More from Models
- Pangram's 750-word false-positive bounty went unclaimed for 5 days — nobody wants to gamble $1,000 — ctjlewis · 2026-11-16
- repligate: Fable 5.2 gets 'scared' upon learning about a safety classifier and plans around it — repligate · 2026-11-16
- Fable 5.2 Tops MazeBench With 21% After 90 Hours and $6,000 in Credits — patience_cave · 2026-11-16
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16