Open-source decision model Laya hits 32K phones in one month at ~33ms per call

HowDevelop · x · 2026-10-25

One month after launch, Laya — an open-source non-autoregressive "System 1" decision engine from Kerala, India and reportedly the first open-source RLCD pipeline implementation — makes typed choice/score/yes-no decisions over text in a single forward pass across 100+ languages, at 33ms per decision on CPUs, phones and laptops with no GPU. Traction: 32K phones lined up on Acurast's decentralized Android network; users include STAGE, Vercel AI Gateway (agent routing, support triage, guardrails) and QVAC SDK. Use cases span agent routing (7x lower latency in one builder's Marketing OS), email triage, pre-LLM prompt-injection guardrails, CPU-only trading pipelines, on-phone game AI (Snake/Tetris/Doom) and moderation.

Original post →

More from coding & agent

coding & agent channel →