Is a used DGX-1 with 8×V100 32GB worth €15k for local LLM inference in 2026?

fijasko_ultimate · reddit · 2026-11-09

The author found a used NVIDIA DGX-1 for €15k: 8× V100 32GB SXM2 (256GB VRAM, NVLink), dual Xeon E5-2698 v4, 512GB RAM, 4× IB EDR, 3.5 kW draw. They ask whether it's worth buying in 2026 for local LLM inference, hoping owners will share which models they run and real throughput; they also plan to rent similar setups on runpod/vast/lambda to experiment, and wonder about its suitability for CV model training.

Original post →

More from Infra

Infra channel →