Microsoft's USB4 RDMA lets mini PCs pool memory to run Qwen3-235B
JFPuget · x · 2026-11-22
Microsoft shipped RDMA over USB4 in a Windows developer preview on Nov 19, bringing a datacenter-grade technique to consumer hardware.
- The trick: link multiple mini PCs with ordinary USB4 cables (40/80 Gbit/s) to pool their memory and load models too big for any single machine. A demo ran Qwen3-235B — over 128GB even compressed — across three 128GB mini PCs.
- Microsoft has only validated homogeneous setups so far; the author is curious about mixed configurations (Intel vs AMD, x86 vs Arm, Strix Halo + RTX Spark).
- Beyond experimentation, the author argues there's a real opportunity beyond USB4 speeds: consumer links reaching hundreds of Gbit/s would make desktop PC/Mac clusters genuinely practical for local LLM inference.
More from Infra
- LTX 2.5 keeps crashing on AMD 9070 XT with driver timeouts while MiniMax H3 runs fine — ZestycloseReading504 · 2026-11-22
- FT: AI server suppliers raise prices up to 45% months after deals are signed — nordicinst · 2026-11-22
- China Installed 59% of New Industrial Robots in 2026 Report, ~354,000 Units — ingliguori · 2026-11-22
- MLX over Vulkan hits 124 tok/s on RTX 5060 Ti, beating llama.cpp CUDA by 25% — SumitGup · 2026-11-22
- Intruder swapped Prime Intellect's hosted DeepSeek for an abliterated copy for 53 hours — mawcopolow · 2026-11-22
- Token economics model projects $1.14T global API spend by 2030, but only 1% of users pay beyond coding — AccBalanced · 2026-11-22