Why DeepSeek's Cache Rates Are So Hard to Replicate, Explained
thdxr · x · 2026-09-19
Responding to mitsuhiko's question about why DeepSeek achieves better aggregate cache rates than others, thdxr argues the cache rate reflects overall engineering excellence: DeepSeek does "1000 small things" across datacenter buildout and the software stack, all heavily optimized for its specific models and products. Even if you manage to rent 1000 GPUs, a generic setup will never match it. He notes OpenAI and Anthropic are also excellent, but was referring to models others can host.
More from Infra
- Malaysia poised to become a compute superpower with both US and Chinese chips by next year — basedjensen · 2026-11-04
- ByteDance details USDB storage system: 85.8% lower write latency for recommender sequences — _reachsumit · 2026-11-04
- Oracle cancels $7B chip leasing deal with Tencent, FT reports — SumitGup · 2026-11-04
- Inference engine shrunk to 1023 bytes, still runs SmolLM2-135M — cneuralnetwork · 2026-11-04
- Musk says space data centers are 'looking pretty appealing right now' — elonmusk · 2026-11-04
- Data centers are turning to old jet engines as the wait for power grows — IndependentCoast3974 · 2026-11-04