Five DGX Sparks Run Hot Serving vLLM — And It's the CPU, Not the GPU
EAccelerate_42 · x · 2026-08-18
An investigation into DGX Spark (GB10) units running hot while continuously serving 27B-class models via vLLM — including Qwen3.8-27B NVFP4 and DeepSeek-V4-Flash. With five 128GB units on a 200GbE fabric running around the clock, the author found the heat source is not the GPU but the GB-10 CPU, which runs hot even when idling.
More from Infra
- Google to Acquire Spirit Airlines' Enterprise Data for $10M — zephyr_z9 · 2026-08-18
- Scaling ML Infra for Million-Hour Robot Training — JasonMa2020 · 2026-08-18
- Stop Indexing at Full Precision: Compressed Vectors Cut Storage by 60x — _reachsumit · 2026-08-18
- Red Hat Releases OGX Open-Source GenAI Application Server — _reachsumit · 2026-08-18
- Coherent says it will keep all its data-center lasers for itself as internal demand eats 100% of output — Novel-Lifeguard6491 · 2026-08-18
- HBM Inventor Criticizes Samsung's zHBM: Stacking Memory on GPU Causes Melting — zephyr_z9 · 2026-08-18