Enthusiast Shares 3-Year Journey of Building 4x RTX 6000 Pro Local AI Cluster
Tourus · reddit · 2026-08-09
A developer detailed the 3-year evolution of their local AI cluster, scaling from a single gaming GPU to 4x RTX 6000 Pro Max Q + 4x RTX 3090s. The core motivation was keeping private data offline and ensuring stable local inference.
The author shared extensive hardware troubleshooting experiences: low-quality PSUs and PCIe cables caused GPUs to drop off the bus and nearly started a fire. He notes that cloud computing is undeniably cheaper for pure compute; the local build is strictly for privacy and enthusiast purposes. Currently, 90% of the cluster's usage is for startup development, completely eliminating API rate limits and key leakage worries, while smoothly running models like GLM 5.2 and various image/voice workflows.
More from Infra
- Zero's next-gen IVM engine runs in a single DO, live-querying a 100GiB R2 database — threepointone · 2026-10-16
- Meme: driving to the chip factory in 2028 captures AI's compute anxiety — beffjezos · 2026-10-16
- One volunteer maintains the time zone file behind 4 billion phones — danbri · 2026-10-16
- DeepSeek V4.1 Flash on 4x DGX Spark: weights alone are 511GB, the 494 tok/s claim doesn't fit — Aroochacha · 2026-10-16
- Open-sourced Intel GPU Vulkan inference upgrades: 2x ingestion, 60%+ faster inference — Fun-Aardvark-1143 · 2026-10-16
- ELSFP pain points: >3dB insertion loss, costly PMF, harsh packaging requirements — jwt0625 · 2026-10-16