NVIDIA says RDMA cut DeepSeek-V4 Pro startup from 8 minutes to under 2

RisingSayak · x · 2026-07-25

NVIDIA says it cut DeepSeek-V4 Pro startup time from 8 minutes to under 2 minutes.

The improvement comes from moving weights over the fastest path to GPU memory with GPU-to-GPU RDMA. NVIDIA says the approach is implemented through ModelExpress (MX) inside NVIDIA Dynamo, and it also speeds up inference and RL post-training by reusing kernel caches and fetching updated weights efficiently.

Related event: NVIDIA Slashes DeepSeek-V4 Pro Startup Time to Under 2 Minutes(4 posts)→

Original post →

More from Infra

Infra channel →