DeepSeek-V4-Flash benchmarks: 286 tok/s single-stream, +34% boost with speculative decoding
mcraddock · x · 2026-08-19
Benchmark results for DeepSeek-V4-Flash on a single DGX Station GB300 have been shared. The model achieves 286 tok/s single-stream and 4,553 tok/s at 32 concurrent requests, with a WikiText-2 perplexity of 5.128. Notably, switching to dspark speculative decoding using 7 draft tokens yielded a 34% performance improvement over MTP-3.
Related event: DeepSeek-V4-Flash Benchmarks Show Up to 4,550 tok/s on a Single GB300(2 posts)→
More from Infra
- Prediction: Opus 5.5-level models on laptops by 2027, backed by Qwen 27B data — cephaloform · 2026-10-16
- Oracle down 12% in a week, nearly 50% off June high as OpenAI exposure spooks market — alvelda · 2026-10-16
- US data center moratoriums top 400 — an AI bull explains why they're actually good for AI — kevinsxu · 2026-10-16
- Microsoft Research unveils Magnetar, the fastest zkVM at 10-39x speedups and post-quantum security — jedisct1 · 2026-10-16
- Bonsai 2 2B hits 120 tok/s on iPhone 18 Pro, outpaces Qwen 3.5 2B at half the memory — cephaloform · 2026-10-16
- Samsung cuts Q4 phone output as Nittobo shifts E-glass to AI-chip T-glass — zephyr_z9 · 2026-10-16