Siri AI's Skimmer: regex-only fast path calls tools up to 20× faster than LLMs

SumitGup · x · 2026-11-11

A teardown of Siri AI's on-device first stage, Skimmer: it uses regular expressions to match requests to deterministic tool flows, filling tool arguments without running any LLM. Measured: 'play' music tool calls in under 120ms (up to 6× faster than on-device/PCC models), simple tools like 'flip coin' under 60ms (up to 20× faster). Since no model runs, latency is consistent across devices and works offline; unmatched queries fall back to on-device/PCC models. The rules are browsable on macOS in Enigma.json under IntelligenceFlowPlannerSupport.framework.

Original post →

More from Models

Models channel →