Laya: open-source 322M model matches TypeSafe Jev with 21ms local decisions

markjeffrey · x · 2026-09-21

Laya is an Apache-2.0 open-source alternative to TypeSafe Jev: a 322M-parameter, 650MB model that decides instead of chatting — typed answers with real probabilities in 21ms on an Apple M1 Max, roughly 200x faster than a hosted LLM, with zero tokens generated. On the same 500 examples Jev is more accurate out of the box, but Laya matches it on simple questions, runs offline, is free per call, and is fine-tunable. Its author published the underlying work in March 2025, 18 months before Jev launched. Unlike a BERT classifier, the question is set at request time — one System 1 model handles any typed question with no per-task training.

Related event: Open-source Laya emerges hours after Jev goes closed-source(4 posts)→

Original post →

More from Models

Models channel →