You.com launches Inference Router: co-located search cuts latency 15%, open models match closed ones at 75% less cost
RichardSocher · x · 2026-10-23
You.com CEO Richard Socher announced Inference Router, an enterprise inference service bundling leading open-weight models, built-in web search, 99.9% uptime SLA with service credits, zero data retention, US-hosted infrastructure, and multi-provider failover behind one OpenAI-compatible API with no platform fee. Search runs on the same server as the model, cutting latency 15% in internal testing. In an independent Braintrust evaluation, an open-weight model with You.com's web search matched or beat a leading closed model's built-in search at up to 75% lower cost per question. The company has run AI + web search together in production since 2022, powering 2B search API calls/month.
Related event: You.com Launches Enterprise Inference Router with 99.9% SLA(5 posts)→
More from Infra
- Investor Ron Baron claims SpaceX books $25B a year selling compute to Anthropic and Google — elonmusk · 2026-10-23
- Open-source Phosphene renders Hailuo H3 2.3x faster locally on Mac — cocktailpeanut · 2026-10-23
- Modal raises $750M at $15.75B as inference booms; 20VC probes AI valuation cracks — sarahcat21 · 2026-10-23
- Cadence announces sovereign AI cloud for European chip designers — karlfreund · 2026-10-23
- SGLang Deep-Dive Blog Series Breaks Down KV Cache, Posts up to 15.5x Throughput Gains — BanghuaZ · 2026-10-23
- DynaLM: Open-Source CPU-First LLM Inference Engine Seeks Feedback — Unlikely_Safety_7456 · 2026-10-23