OpenAI's Habitat storage handled 20M+ requests/sec in Python before Rust rewrite
marlene_zw · x · 2026-09-14
OpenAI's developer team revealed that Habitat, the online storage platform powering everything from ChatGPT to Codex, has grown over 10x year over year. Before a Rust rewrite, its Python service handled more than 20 million requests per second at peak. The poster quips that Python remains good enough for nearly all business use cases up to that scale.
More from Infra
- Poll: 61% of Americans oppose AI data center construction, young adults most opposed — justin_hart · 2026-09-15
- 24,600 generations show quantization costs aren't uniform: Q2 keeps JSON perfect but tanks arithmetic 66% — Tensor_Ghost_03 · 2026-09-15
- Neoclouds: How Failed Companies Became AI's Biggest Winners — economics of the GPU cloud boom — bycloud · 2026-09-15
- Subnormal floats are expensive — but only on Intel, benchmarks show — lemire · 2026-09-15
- LLM Inference Engineer dubbed the most AI-proof job by tech commentator — ashishllm · 2026-09-15
- SGLang and Samsung whitepaper: 3.1x lower LLM inference latency via AI Memory Node — ying11231 · 2026-09-15