Perplexity's CobbleDB cuts p99 latency from 123ms to 24.2ms, replacing DynamoDB
perplexity_ai · x · 2026-09-16
Perplexity has unveiled CobbleDB, a purpose-built storage engine optimized for repeated batch reads of prepared page records in its AI search workload.
Production before-and-after measurements after replacing DynamoDB:
- Median batch-read latency dropped from 31.4ms to 5.60ms
- p99 latency fell from 123ms to 24.2ms
- Internal cost model estimates at least 20% savings versus DynamoDB
The team plans to open-source CobbleDB for other teams building AI search.
More from Infra
- AI Defense Agents Running 24/7 Could Send Token Costs Through the Roof — robleclerc · 2026-11-02
- LookAtMyQuant: a quantization compiler with 12x lower KL at Q4_K_M size on Gemma 4 E2B — teortaxesTex · 2026-11-02
- AI Data Centers Near a PC-Style Inflection Point: OCP Analysis of Power, Cooling, Networking — ai · 2026-11-02
- Cerebras halves in 5 months post-IPO: $25.4B order book leans heavily on OpenAI — FinanceYF5 · 2026-11-02
- Together launches post-training platform aligning RL training with serving — togethercompute · 2026-11-02
- Demis Hassabis: AI data centers should be beautiful — Recent_Fox4339 · 2026-11-02