DGX Spark Matches B300 Servers at ~$4,700 Per PFLOP, Sparking Decentralized Pretraining Idea
jon_durbin · x · 2026-08-20
Jon Durbin runs the numbers: NVIDIA B300 servers start around $350k (8 GPUs, $43,750 each) for 9 PFLOPS dense FP4, with brutal power/cooling needs and near-zero availability—about $4,861 per PFLOP.
Meanwhile the $4,700 DGX Spark plugs into any household 15-amp outlet and delivers 1 PFLOP (FP4 sparse)—roughly $4,700 per PFLOP, essentially on par with B300.
His takeaway: decentralized pretraining on DGX Spark clusters using native sparse FP4 (ternary weights fit sparse FP4 compute nicely) should be a thing—and he's about to test it.
Related event: Cost Analysis: DGX Spark Matches B300 Server Per-PFLOP Value(2 posts)→
More from Infra
- Monad Agent Hub launches with no-code platforms for instant agent creation — bgmshana · 2026-08-20
- Benchmark: MiniMax H3 Generation Speeds on AMD 9070 XT — Ok-Brain-5729 · 2026-08-20
- AWS Leverages AI Infrastructure Demand to Extend Cloud Dominance — DavidLinthicum · 2026-08-20
- Reverse-Engineering RK3588 NPU: Open Compiler Runs GPT-2 at 36 tok/s — one_does_not_just · 2026-08-20
- llama.cpp dflash2: Qwen 3.8 27B Inference Speed Up to 3x — Top-Eye-8104 · 2026-08-20
- NVIDIA announces FLARE Day event for September — AllThingsApx · 2026-08-20