8 mixed GPUs plus 256GB DDR4 vs DGX Spark: is this MoE inference rig viable?
Ambitious_Fold_2874 · reddit · 2026-10-25
A Reddit user has assembled 4x RTX 5060 Ti 16GB + 4x RTX 3060 12GB with 256GB DDR4-3200 on a board with 128 PCIe 4.0 lanes, at cost comparable to a DGX Spark. They ask whether such a heterogeneous multi-GPU setup can run large MoE models fast and accurately, or whether it's badly suboptimal versus unified memory architectures.
More from Infra
- Survival LLM: Free Offline AI Assistant Bundling 1.5M Emergency Articles, No Internet Needed — burny_tech · 2026-10-25
- SGLang vs vLLM: the inference framework race has no weekends — AccBalanced · 2026-10-25
- CASPA summit: chip-to-chip interconnect eats 60-70% of package energy, AI chip design targets 9-month cycles — ai · 2026-10-25
- DeepMind paper: 5-second-per-layer quadratic simulations predict LLM training spikes — burny_tech · 2026-10-25
- Ontology-Driven Observability: Building an End-to-End Knowledge Graph at Netflix Scale — blaizedsouza · 2026-10-25
- Memory is 70-80% of AI rack silicon, and Rasgon asks what if prices never collapse — firstadopter · 2026-10-25