You.com launches Inference Router: enterprise open-model inference with 99.9% SLA
Zai_org · x · 2026-10-23
You.com introduced Inference Router, an enterprise-grade on-demand inference service for leading open-weight models, touting a minimum 99.9% uptime SLA, zero data retention, US hosting, built-in web search, and zero platform fees, with claimed inference cost savings of up to 75%.
Listed models include Kimi K3, GLM 5.3, DeepSeek V4.1 Flash, Qwen3.8 Flash, Meta's Muse Spark 1.3, and Mercury 3, organized by workload type (coding & agents, long context, high volume, thinking). Customer testimonials report halved inference bills, better agent latency, and less downtime than closed-weight model APIs.
Related event: You.com Launches Inference Router for Enterprise LLM Inference(6 posts)→
More from Infra
- MiniMax Open-Sources M3.1 Flash: 428B Params, 23B Active, NVIDIA Vera Rubin Day-0 Support — NVIDIAAI · 2026-10-23
- Inco Open-Sources DFlash 2 Drafter: Lossless 3.5× Speedup for MiniMax M3.1 Flash — Lianhuiq · 2026-10-23
- vLLM details M3.1 Flash serving: NVFP4 cuts weights 44.6%, boosts capacity 2.7x — vllm_project · 2026-10-23
- M3.1 Flash hits 191.5k tok/s per GPU on Vera Rubin NVL72, leads open models on agent benchmarks — vllm_project · 2026-10-23
- Agents that don't close connections on retry waste ~148 tokens per task, vLLM tests show — No-Peanut-6988 · 2026-10-23
- Ex-Googler with 35 Years in Software Pursues Local AI Coding and Music Video Generation — julianharris · 2026-10-23