Baseten runs DeepSeek v4.1 Flash at ~2500 tok/s on Vera Rubin

Baseten reported that DeepSeek v4.1 Flash achieves about 2500 tokens per second on Nvidia's Vera Rubin hardware using batch size 1 and TP4 configuration, showcasing its latest low-latency inference optimizations.

2026-11-17 ~ 2026-11-17 · 2 related posts

Full story(2 episodes)→