Running DeepSeek V4 on 16x RTX 5060 Ti via PLX switches
Primary_Exchange21 · reddit · 2026-08-20
A user shared a detailed hardware setup using 16x RTX 5060 Ti 16GB GPUs connected via two PLX88096 switches to run DeepSeek V4 Flash-0731.
- Configuration: Uses an ASRock Rack motherboard, Xeon Gold 6330 CPU, and custom kernel parameters to force 16GB BAR1 on each card.
- Performance:
- TP8 + PP2: 500k context, 140 tks.
- TP4 + PP4: 1M context, 80 tks.
- Cost: The entire setup cost 0.6x the price of a single RTX 6000 Pro.
More from Infra
- Guangdong, Alibaba Sign Strategic Pact to Boost AI, Chips and Computing Power — pstAsiatech · 2026-08-20
- GPU Market Pricing Chaos: Spreads Wide Across Venues — AccBalanced · 2026-08-20
- Dual RTX 3090 running Qwen3.8-27B locally at 50-65 tok/s — is that normal? — sugarfreecaffeine · 2026-08-20
- AVX-512 Deemed Superior to ARM SVE: Register & Masking Edge — lemire · 2026-08-20
- Modular open sources platform repo integrating MAX engine and Mojo language — modular · 2026-08-20
- vLLM precision gap prevents GRPO convergence — SergioPaniego · 2026-08-20