DGX Spark Cluster vs AMD Epyc Server: A Cost-Benefit Comparison
LeftHandHaku · reddit · 2026-09-02
The author compares two local compute setups costing around $16k: a cluster of 4x DGX Sparks (512GB total VRAM) vs an AMD Epyc 9xx5 server (768GB/384GB DDR5 RAM + 2x3090/5080). The Epyc offers significantly higher theoretical bandwidth (576GB/s vs 273GB/s). The post seeks advice on the benefits of choosing a DGX cluster over the Epyc system, beyond just power savings.
More from Infra
- Texas Freezes Data Center Grid Connections Over Uncertain AI Power Demand — VraserX · 2026-09-02
- Google Infra Head: A Gemini prompt consumes energy equal to 7 seconds of TV — BenBajarin · 2026-09-02
- Running 104GB Qwen3.8-Flash-Next on 48GB Mac at ~12 tok/s — yogthos · 2026-09-02
- Not Diamond releases model routing method, cuts costs 20-80% — rohanpaul_ai · 2026-09-02
- Trading VRAM for FLOPs: Local Model Quantization Debate — max_paperclips · 2026-09-02
- User complains about dev tool hogging 98% RAM, requests local GPU support — MickeySteamboat · 2026-09-02