Laya open-sourced: 33ms non-autoregressive decision model with routing
duummbass · x · 2026-09-20
convaiinnovations open-sourced Laya on Hugging Face: a multilingual, non-autoregressive System 1 decision model. Given a state (text, email, ticket, or JSON) and typed questions, it returns typed answers with mathematically calibrated probabilities in a single forward pass (33 ms) across 100+ languages. It is trained with RL against strictly proper scoring rules (RLCD), so honest probability reporting is the only reward-maximizing strategy; it never generates text, so there is nothing to parse or hallucinate. The repo ships three checkpoints: English (ModernBERT-large, 421M, 512 ctx, best at guardrails/email triage), multilingual (mmBERT-base, 322M, 1024 ctx, 2.2x faster), and typed-decisions (421M, 0.766 acc on four workflows). Recommended usage is the built-in Router: pip install laya, preload checkpoints, and route in under 35 ms. Users suggested adding it to JevBench-style routing evaluations.
Related event: Open-source Laya emerges hours after Jev goes closed-source(4 posts)→
More from coding & agent
- Indie Britpop AI music video built with Nano Banana Pro, Kling, and free lip-sync via WAN2GP + LTX 2.5 — cocktailpeanut · 2026-11-12
- Cloudflare Talk: Swapping Some Agent LLM Calls for Fast Models Like Jev Gives Big Speedups — michellechen · 2026-11-12
- Engineer Curates 15 AI Agent Design Patterns Across Single-Agent, Multi-Agent and Feedback Tiers — MaryamMiradi · 2026-11-12
- Google Antigravity rolls out browser use, closing the loop from research to coding to live verification — rseroter · 2026-11-12
- Prettier 3.10 ships new Flow/JS syntax and a Zig-powered Yuku plugin — Vjeux · 2026-11-12
- YC-backed Graphide claims CI runner 10-20x faster than GitHub on 24 repos — ycombinator · 2026-11-12