Developer racks six ASUS GX10 boxes, 128GB VRAM each, for local LLM inference
glenbeer · x · 2026-10-23
A developer showed off a rack with six ASUS GX10 mini AI hosts, each with 128GB of unified memory — up to 768GB total — with one kept on the desk. Such machines are popular for serving large LLMs locally, making this a notable low-cost private inference cluster setup.
More from Infra
- SK Hyper in talks to fund envisioned $350B AI data center buildout in South Korea — dinabass · 2026-10-23
- MiniMax M3.1 Flash hits >1K tok/s decode with day-0 SGLang support across NVIDIA and AMD — MiniMax_AI · 2026-10-23
- MiniMax-M3.1-Flash goes open weights with day-0 NVIDIA NeMo fine-tuning up to 128 GPUs — MiniMax_AI · 2026-10-23
- RadixArk caught paying KOLs to coordinate quote-posts of SGLang announcement — EugeneVinitsky · 2026-10-23
- MiniMax partners with vLLM creators' Inferact for day-zero production inference of open models — woosuk_k · 2026-10-23
- Local LLM shootout: Flint 40B MoE vs Qwen3.8-27B on identical RTX A6000s — RichardSocher · 2026-10-23