Running DeepSeek V4-Flash Locally: Dual RTX 6000 Rig Handles Only Single User
dee_hw · x · 2026-08-02
A developer shared hands-on experience running DeepSeek V4-Flash on a 2× RTX PRO 6000 build.
- VRAM limits: VRAM caps the context at 131K. This means if two requests each exceed 65K context, one has to wait for the other to finish.
- Context usage: A coding task typically runs >60K context, an agentic task 30–40K, and a chat app 10–15K.
- Verdict: This rig is great for a single personal user and fine for a small team, but it is not suitable as a production box.
Related event: DeepSeek V4 Flash Sparks a Wave of Local Deployment Tests(26 posts)→
More from Infra
- MiniCPM-V 4.5 MoE reportedly hits 13+ tokens/s on iPhone with just 3GB memory — heyshrutimishra · 2026-10-16
- Solo-built Vulkan inference engine LaForge hits ComfyUI-level SD1.5 speed: 512px in 0.8s, 402MB container — Ichidan256 · 2026-10-16
- Trading 2 RTX 5090s for 4 R9700s: does doubled VRAM pay off? — poofph · 2026-10-16
- Running PolyStrata + Cline coding agent on a $0-fancy laptop at ~90 tok/s — rpwoerk · 2026-10-16
- TensorFold 1.0.12 runs 120B vision model on 1-2 DGX Sparks, adds Mac image input — HankYeomans · 2026-10-16
- vLLM brings frontier model local deployment to NVIDIA RTX Spark PCs — vllm_project · 2026-10-16