Building a local LLM station: is a cheap V100 still worth it over a 9700?
Numerous-Ad6217 · reddit · 2026-10-17
A first-time local LLM builder asks whether to pick a significantly cheaper V100 over an RTX 9700, given that V100 is no longer supported by future CUDA releases. They wonder if ongoing optimization trends (n-grams for MoE, diffusion approaches) offset the risk, and admit feeling overwhelmed by the pace of the field.
More from Infra
- AgentCave puts your scattered Macs and GPU boxes in one virtual room — noahsolomon · 2026-10-18
- Real AI demand estimated at ~$189B in 2026, over half from OpenAI and Anthropic — builderjaydub · 2026-10-18
- Twinax cable shipments in AI backplanes hit 85,200 km/year at 224G — moon-length in 4.5 years — jwt0625 · 2026-10-18
- DeepSeek-4.1-Flash Runs on 4x RTX Pro at 300+ TPS With NVMe Offload — TheZachMueller · 2026-10-18
- SGLang Summit sponsors jump from 11 to 36 in one week, 2,000+ attendees expected — ying11231 · 2026-10-18
- Agent search drops matrix multiplication exponent below 2.7 at ~500M matrix size — IgorCarron · 2026-10-18