Lawyer's 8x V100 private AI server runs 80% of DeepSeek V4.1 Flash at 4-bit nvfp4
General-Spite1222 · reddit · 2026-11-14
Tom's Hardware picked up the Reddit lawyer's DIY story: he upgraded his eight-V100 private AI server with 1TB of RAM and an RTX 3090 to run about 80% of DeepSeek V4.1 Flash at 4-bit nvfp4 precision, and traced crashes to a bad PSU.
More from Infra
- Anyone actually running local LLMs on a DGX Station B300? Seeking real-world numbers — spaham · 2026-11-14
- A Firewall Rule Against Scrapers Can Quietly Erase Your Pages From ChatGPT Answers — shashib · 2026-11-14
- What's Next for Nvidia Without Jensen Huang? Analyst Breaks Down the Crisis — terencemauri · 2026-11-14
- QuixiGate: Rust LLM gateway posts 8ms cold start and 24MiB RAM, ~29x LiteLLM JSON throughput — QuixiAI · 2026-11-14
- OpenOrange claims 34.8x lower S3 costs for agent workloads via Rivet's storage engine — vincent_koc · 2026-11-14
- Sacks claims DeepSeek trains solely on Huawei chips; observers push back on the 6-month gap narrative — ShakeelHashim · 2026-11-14