Sabaki: MIT-licensed typed decision router runs on CPU in milliseconds
Fox3000foxy · reddit · 2026-10-16
The author released Sabaki, a free MIT-licensed typed-decision router for CPUs: unstructured state in, typed answer out (choice/score/noul) with calibrated confidence. It uses keyword routing over tiny specialists (TF-IDF <1ms, MiniLM int8 20ms) with a cross-encoder fallback for open questions, exposes a Jev-compatible HTTP API, and runs fully offline. Honest numbers: 0.61/0.69 versus 0.75–0.80 for 400M+ models — trading points for 1000x lower latency. The calibration writeup documents a failed Platt attempt and a batch-drift finding in the benchmark itself. Install via npm i sabaki; the author invites the community to find where it breaks.
More from coding & agent
- Deep Research API showdown: OpenAI, Perplexity, Parallel, Tavily, Gemini, Valyu compared — bar_raiser333 · 2026-10-16
- Geoffrey Huntley open-sources Overalls, a self-hosted AI developer platform under MIT — kieranklaassen · 2026-10-16
- Dev shows 199.7bn tokens over 200 days on OpenAI Codex, peak 8.6bn/day — Dimillian · 2026-10-16
- Ask Claude to open its changes in nvim and scroll to the exact line for review — max__drake · 2026-10-16
- Proof CEO on x401: KYC-compatible agent identity using NIST IAL2 verifiable credentials, composing with x402 payments — csuwildcat · 2026-10-16
- Pydantic's HTTPX2 adds native WebSocket and SSE support — samuelcolvin · 2026-10-16