DeepSeek's DSec Sandbox Fleet Is ~320 EPYC 9655 Chips, 30,720 Cores
teortaxesTex · x · 2026-09-23
A follow-up correction: DeepSeek's DSec unit is roughly 320 EPYC 9655 chips (160 nodes x 2, 96 cores each) = 30,720 cores. At peak that's 12.6 concurrent sandboxes per CPU core — an estimated 25-30% of max achievable CPU utilization (DeepSeek reports 41.4% transient peak), leading the author to argue even OpenAI couldn't do 4x better.
Related event: DeepSeek Sandbox Cluster Details Emerge, Estimated $20M Per Unit(3 posts)→
More from Infra
- tinygrad hits ~200 tok/s MiMo-V2.6-Pro on MI300X, brought up via GLM-5.3 — AIFlow_ML · 2026-09-23
- Rumors: 64GB+ VRAM RTX 5090 in R&D but not coming anytime soon — AIFlow_ML · 2026-09-23
- Swarm-built inference engine runs Qwen Image-2.1: 1K images in under 0.5s — bingxu_ · 2026-09-23
- MLX MTP head silently ignored: a 3-line fix boosts Mac local decode speed by up to 79% — Micha0827 · 2026-09-23
- Pluton: open-source self-hosted backup platform wrapping Restic and Rclone for encrypted cloud replication — tom_doerr · 2026-09-23
- TensorSharp's logit-reading approach beats LocalJev at structured decisions, 3.3x faster — fuzhongkai · 2026-09-23