Baseten adds server-side web search for open models, 15% lower latency
baseten · x · 2026-09-17
Baseten launched Hosted Tools and Grounded Inference, bringing real-time server-side web search to open-weight models via a single configuration with partners Exa, Keenable, p0, and You.com — eliminating hand-wired orchestration, extra vendor keys, and per-round-trip latency, with claimed 15% lower latency than client-side execution. You.com also touts its Highlights mode scoring 95.17% on SimpleQA, 35% cheaper than Claude's built-in web search.
Related event: Baseten Launches Hosted Tools and Grounded Inference for Open-Weight Models(6 posts)→
More from Infra
- Big Tech's Future Data Center Leases Top $1.3T, 70% Added in Last Four Quarters — rohanpaul_ai · 2026-11-02
- Daniel Lemire: AI is exploding demand for boring compute, server CPUs to double — lemire · 2026-11-02
- Physical AI's real story: a 4-layer map of 15 companies behind humanoid robots — pdamodaran · 2026-11-02
- Under 5% of US consumers pay for AI, yet compute demand is already forcing usage cuts — NinaDSchick · 2026-11-02
- Sam Altman: AI query energy cost fell 1,000x-100,000x in 3-4 years — rohanpaul_ai · 2026-11-02
- Marvell and Lumentum to merge, targeting $550B AI connectivity market — BenBajarin · 2026-11-02