Dev shows local LLM rig: Ryzen 9 9950X3D plus dual Xeons with 600GB RAM
kevinnbass · x · 2026-11-11
Developer kevinnbass shares his Ubuntu-based local inference setup: an AMD Ryzen 9 9950X3D (32 threads) plus two Intel Xeon E5-2680 v4 ES chips (56 threads), totaling 600GB of RAM across machines, with plans to add two more. A glimpse into budget-friendly personal LLM inference clusters.
Related event: Devs Show Off Home Clusters for Running AI Agents(4 posts)→
More from Infra
- Huawei's TSMC 'White Glove' Chip Orders Resurface in Debate over Megaspeed's $4.8B Nvidia Buys — 0xkarasy · 2026-11-11
- Data Center Backlash Spreads: Community Outrage Kills Upstate NY Project on Abandoned Steel Plant — sebkrier · 2026-11-11
- AMD's AI World Tour Japan: global monthly token consumption up 158x in two years — DavidBennett__ · 2026-11-11
- vLLM crosses 4,000 GitHub contributors, growing from a Berkeley research project — vllm_project · 2026-11-11
- 40k agent calls show prefix stability, not model choice, drives 4-5x cost gaps — MichelleZhao91 · 2026-11-11
- LMCache taps Phoenix GPU direct storage, cutting TTFT 5.6x on NVMe-backed KV caches — AccBalanced · 2026-11-11