Open System 1 model runs at 45ms per query on laptop CPU, 70% on support tickets

ghumare64 · x · 2026-09-26

The author ran open System 1 models (Laya and Jev by @typesafeai) on a laptop CPU at 45ms per question. On 30 hand-labeled support tickets it scored 70%, but 6 of its 9 errors came at 0.98+ confidence — e.g. classifying "I do not want to cancel my account" as cancelaccount. High-confidence errors are the key deployment risk.

Related event: System 1 models classify tickets in milliseconds on laptop CPUs(3 posts)→

Original post →

More from Models

Models channel →