DeepSeek-V4-Flash hits 48.9 tok/s on single DGX Spark with speculative decoding
max_paperclips · x · 2026-08-03
Developer @danpacary successfully ran the 81GB DeepSeek-V4-Flash-0731 model on a single DGX Spark.
- Hardware: 128GB memory
- Plain decode: 22.5 tok/s
- Speculative decoding: Adding a 6.5GB drafter model boosted speed to 48.9 tok/s
The test utilizes the ds4 inference engine developed by antirez.
More from Infra
- Dally 2022 Model: SRAM Access Energy Varies by Two Orders of Magnitude — jwt0625 · 2026-08-03
- Google TPU Demand Surge: Projected to Reach 15M Units by 2028 — SumitGup · 2026-08-03
- Running MiniMax H3 Locally on RTX 5070Ti: 480p Video in 130 Seconds — tricck3zz · 2026-08-03
- Run 2.78T Parameter Kimi K3 on a Single CPU in 8.24GB RAM — Saboo_Shubham_ · 2026-08-03
- tinygrad Teases Local Deployment Product, Hints at Upcoming Qwen3.6-27B — max_paperclips · 2026-08-03
- AMD MI355X Beats NVIDIA B200 in Kimi K3 Deployment with 952 tok/s — adrianscottcom · 2026-08-03