Is a used 64-core Threadripper PRO 3995WX worth it for a multi-GPU LLM server?
Ammoryyy · reddit · 2026-10-31
A Reddit user found a used workstation with a 64-core Threadripper PRO 3995WX, 224GB DDR4-3200, and an 850W PSU, and plans to build a local LLM inference server with 4–8 RTX 3090s running llama.cpp, vLLM, or SGLang for large MoE models.
Key discussion points:
- Fair used pricing and whether the board is the ASUS Pro WS WRX80E-SAGE SE (seven PCIe 4.0 x16 slots)
- ECC RDIMM vs consumer UDIMM compatibility
- Practicality of running 4–7 GPUs via risers and external PSUs
- Whether 3995WX still makes sense for MoE CPU offloading vs a cheaper EPYC platform
More from Infra
- Local LLM newbies puzzled: why build a custom harness instead of using Unsloth? — Marino4K · 2026-11-01
- Grafana's Cloud Knowledge Graph now accepts Cypher queries — JeremyCMorgan · 2026-11-01
- Decentralized RL on Bittensor: 100 steps across 12+ GPU models with corrected sampling noise — const_reborn · 2026-11-01
- NASA JPL stress-tests CXMT memory down to -100°C, unit stays online — jwt0625 · 2026-11-01
- Kaggle Resource Usage Up 2-3x as Agents Flood In for ARC Competitions — GregKamradt · 2026-11-01
- Why AI data centers in space are not practical: cooling, radiation and maintenance — johnseach · 2026-11-01