DeepSeek v4 local deployment hits 3000 t/s prefill on DGX Station

antirez · x · 2026-08-18

Redis creator antirez demonstrated extreme performance running DeepSeek v4 PRO on a DGX Station. By leveraging techniques that utilize the station's specific RAM + VRAM hybrid setup, the prefill speed reached 3000 tokens/s, with potential for even higher throughput.

Related event: DeepSeek v4 local deployment hits 3000 t/s prefill on DGX Station(2 posts)→

Original post →

More from Infra

Infra channel →