Laya: 421M open-source model answers with probabilities in a single forward pass
Indian indie developer Nandakishor M (ConvAI Innovations) open-sourced Laya on September 18, which drew 1200+ points and 300k views on Hacker News within a day. Laya returns to the discriminative paradigm: given text and typed questions, a single forward pass yields a probabilistic answer with no text generation, at 40ms on a single T4 (a secondary report cites 33ms). The author published an accompanying blog post, "Laya, Jev and the Return of the Discriminative Model," comparing it with the closed-source Jev (TypeSafe AI); per @thisdudelikesAI, Laya predates Jev by over a year.
Confirmed
- Laya is a 421M-parameter, Apache 2.0 open-source model; one forward pass returns probabilistic answers at 40ms on a T4, generating no text and only doing "System One" style selection/scoring/yes-no judgments.
- Author benchmarks: 0.950 accuracy on AG News at 7x speed; on 77-class Banking77 only 0.425 vs a 0.870 baseline.
- The model card admits the base checkpoint underperforms most baselines zero-shot.
Why it matters
- Amid generative LLM dominance, Laya shows the latency/cost potential of small discriminative models that skip text generation entirely, built open-source by one developer against a closed Silicon Valley product.
- Its collapse on multi-class tasks exposes clear applicability limits; the zero-shot weakness of the base checkpoint is the main shortcoming, acknowledged by the author in the model card.
2026-09-28 ~ 2026-09-28 · 6 related posts
Primary sources
- Laya and Jev: the return of the discriminative model, fast but narrow — maier_ak · 2026-09-28
- 421M-parameter open-source Laya returns answer probabilities in one pass at 40ms on a T4 — maier_ak · 2026-09-28
- [source] Laya: a 421M open-source model answers with probabilities in one 40ms forward pass — maier_ak · 2026-09-28
- [source] 421M-parameter discriminative model Laya is 7x faster but fails badly on 77-label tasks — maier_ak · 2026-09-28
- [source] Laya hits 0.950 on AG News and is 7x faster, but flops on Banking77 — maier_ak · 2026-09-28
- Kerala solo dev open-sources Laya, a 33ms decision model 7x faster than Jev — thisdudelikesAI · 2026-09-28