DeepSeek-V4-Flash Local Inference Optimized: 27% Speedup on a Single DGX Spark
antirez · x · 2026-08-09
Developers have successfully optimized the local inference performance of DeepSeek-V4-Flash on a single DGX Spark using the DwarfStar engine, achieving a 27% speedup with the same weights.
- Decode speed: Increased from 22.5 to 28.6 tok/s
- Prefill speed: Steady at 1060 tok/s
- Optimization details: DwarfStar v0.5.6 added Spark-specific fast paths and enabled speculative decoding during the thinking phase, reaching a 74% draft acceptance rate.
This allows a 284B parameter model to run entirely on a desk without cloud dependency.
Related event: DwarfStar Boosts DeepSeek Inference Speed with Speculative Decoding(2 posts)→
More from Infra
- Zero's next-gen IVM engine runs in a single DO, live-querying a 100GiB R2 database — threepointone · 2026-10-16
- Meme: driving to the chip factory in 2028 captures AI's compute anxiety — beffjezos · 2026-10-16
- One volunteer maintains the time zone file behind 4 billion phones — danbri · 2026-10-16
- DeepSeek V4.1 Flash on 4x DGX Spark: weights alone are 511GB, the 494 tok/s claim doesn't fit — Aroochacha · 2026-10-16
- Open-sourced Intel GPU Vulkan inference upgrades: 2x ingestion, 60%+ faster inference — Fun-Aardvark-1143 · 2026-10-16
- ELSFP pain points: >3dB insertion loss, costly PMF, harsh packaging requirements — jwt0625 · 2026-10-16