DeepSeek-V4-Flash Benchmarks Show Up to 4,550 tok/s on a Single GB300

Benchmarks show DeepSeek-V4-Flash reaching 286 tok/s single-stream and 4,550 tok/s at 32 concurrency on a DGX Station GB300, with speculative decoding adding a 34% speedup.

2026-08-19 ~ 2026-08-19 · 2 related posts