Multi-GPU PCIe Switch Setup Shows Almost No Performance Loss
Old_Grapefruit8774 · reddit · 2026-07-11
The author tested a direct-connect setup for 6 MI50 GPUs on an X99-E-WS motherboard, alongside a hybrid setup using a PEX8749 PCIe switch (4 cards routed through the switch chip, 2 directly connected).
Test Configuration
- Asus X99-E-WS, flashed with a custom BIOS supporting multi-GPU
- Xeon E5-2680 v4
- 128GB DDR4
- Goal: Provide around 1TB VRAM for multi-machine/multi-GPU local AI inference
Results
After multiple runs using llama bench:
- The tg metric typically improved by 0.8%–2.8% under the switch setup
- The pp metric saw less than a 1% loss
- Overall differences across multiple test combinations were minimal, with some scenarios breaking even
Conclusion: On this older platform, hanging部分 GPUs under the PEX8749 switch didn't cause a performance disaster and even yielded slight gains in tg.
More from coding & agent
- Anthropic researcher: 99% of engineers now run swarms of 300+ self-improving agents — AlishaOutridge · 2026-09-11
- Gergely Orosz: Shipping 10x PRs With AI Agents, Sites Fill With Small Regressions — ducha_aiki · 2026-09-11
- Same Echo Maze prompt, three frontier models: all passed visually but shipped the same hidden bug — eyishazyer · 2026-09-11
- Astra storyboards plus Minimax H3 per-shot generation boost video success rates — Hailuo_AI · 2026-09-11
- Codex tip: use Sol with Astra and Luna sub-agents to save usage — pvncher · 2026-09-11
- agents-best-practices: a provider-neutral Agent Skill for designing and auditing agentic harnesses — tom_doerr · 2026-09-11