Open-source sys1 ships a Rust System 1 API for decision models at ~14ms on RTX PRO 6000
IgorCarron · x · 2026-09-24
- sys1 is an open-source, production-ready System 1 API for open decision models, written in Rust
- Built on Candle + Tokenizers, with ModernBERT and Laya decision heads
- Features dynamic token-based batching; runs on CPU, Metal and CUDA
- Reported 14ms latency on an RTX PRO 6000
More from coding & agent
- Standard Code launches unlimited-usage cloud coding agent with $49/mo per-line billing — jasonkneen · 2026-09-24
- Lovable Chat tutorial: voice, file creation, and auto-posting to X via Metricool MCP — MyCreativeOwls · 2026-09-24
- Lovable Chat hands-on: voice, file creation, and auto-posting to X via Metricool MCP — MyCreativeOwls · 2026-09-24
- LangSmith Engine v2 adds agent red teaming and automated fix validation — LangChain · 2026-09-24
- Ando raises $20M to build the 'AI-native Slack' for teams working with agents — beh_zod · 2026-09-24
- Sentry founder: Claude drives 10x Codex's usage, Cursor about 3x — zeeg · 2026-09-24