OpenAI's Habitat storage handled 20M+ requests/sec in Python before Rust rewrite
marlene_zw · x · 2026-09-14
OpenAI's developer team revealed that Habitat, the online storage platform powering everything from ChatGPT to Codex, has grown over 10x year over year. Before a Rust rewrite, its Python service handled more than 20 million requests per second at peak. The poster quips that Python remains good enough for nearly all business use cases up to that scale.
More from Infra
- Your AI agent would cost 260% more without prompt caching, Arena data shows — arena · 2026-10-30
- Nebius runs auction-driven GPU pricing, lifting rates ~20% amid tight supply to 2028 — BenBajarin · 2026-10-30
- macOS update silently re-adds eMudhra root certs users had removed — steipete · 2026-10-30
- Bittensor's Terza Inference routes one API across miners' models on subnet 103 — const_reborn · 2026-10-30
- SGLang Summit 2026 sells out sponsor booths and Full Passes ahead of Nov 12–13 event — ying11231 · 2026-10-30
- OpenRouter rebuilds provider routing: 46% fewer capacity errors, 16.9% faster TTFT — steipete · 2026-10-30