How many GPUs before a PCIe switch makes sense? A 6-slot board owner asks
HankYeomans · x · 2026-10-25
HankYeomans asks at what GPU count a PCIe switch setup starts making sense—2 cards or more—given he has a fast board with six x16 slots.
The original thread explains that inference traffic is tiny compared to link bandwidth, and multiple GPUs can hang off a single slot if RAM offload is avoided and P2P stays enabled.
More from Infra
- Siemens partners with Nvidia on AI-driven factories powered by autonomous agents — emmanuelvivier · 2026-10-25
- Google Cloud launches Agent Compute Engine, a purpose-built sandbox runtime for AI agents — emmanuelvivier · 2026-10-25
- Can RTX 3060 run MiniMax H3 locally? Users weigh hardware requirements — Odd-Rip8379 · 2026-10-25
- Jensen Huang unveils Vera Rubin DSX POD at GTC Berlin, pitches Europe's AI economy — nvidia · 2026-10-25
- TensorSharp ships Day-1 MiniMax-M3.1-Flash support: 9.8× faster 64K prefill than llama.cpp on 8× A40 — fuzhongkai · 2026-10-25
- ANEMLL Forge 0.2.1 runs Qwen3.8-27B at up to 192K context on M6 Mac Mini's Neural Engine — Competitive-Bake4602 · 2026-10-25