Notion indexes 10B+ docs on turbopuffer, cuts search costs 80%
DevinLewtan · x · 2026-11-13
A turbopuffer case study details Notion's search infra: 100M+ users, 10B+ documents indexed, 1M writes/s peaks and 10M+ namespaces. Since migrating in October 2024, Notion cut costs 80% (dropping per-user AI charges), sustains ≥99.99% uptime, and prewarm queries are fired when a search dialog opens to keep namespaces cached.
More from Infra
- RL engineering debate: decoupled rollout vs colocated vLLM, staleness is not a rounding error — willcb · 2026-11-13
- Chutes' Parallax hits ~18,000 tok/s on one RTX 5090, ~1 cent per million tokens — bittingthembits · 2026-11-13
- LLM gateway latency benchmarked: 0.21ms median overhead but 89ms at p99 — jkriket · 2026-11-13
- Miles v0.2 Debuts at SGLang Summit: RL Training Across NVIDIA, AMD, TPU, Trainium — ying11231 · 2026-11-13
- A 14-minute video traces one ChatGPT question from the Enter key to the GPU and back — Glass-Garden-5888 · 2026-11-13
- Burkov's weekly: 94% of UK students use AI for assessed work, CUDA Rust, e-means — burkov · 2026-11-13