DeepSeek-V4.1-Flash EXL3-3bpw quant runs on 2x RTX PRO 6000
No-Paper-557 · reddit · 2026-10-25
A Reddit user shared diffbot's DeepSeek-V4.1-Flash EXL3-3bpw quantized model on Hugging Face, which fits on two RTX PRO 6000 GPUs (192GB total VRAM), offering a lower-VRAM local deployment option.
More from Infra
- 'For rent: GB300s, never used' — two-sentence horror about idle Blackwell GPUs — sloppenheimer · 2026-10-25
- Homelabber finishes 8x RTX 3090 build: 192GB VRAM + 256GB RAM for local LLMs — generativist · 2026-10-25
- Beyond funding, thermodynamics is the real hard limit on AI progress — AryHHAry · 2026-10-25
- KohakUnlock removes RTX 20-series FP16→FP32 lock: 2080 Ti jumps from 59.9 to 111 TFLOPS — CeFurkan · 2026-10-25
- Aggregated 18 ComfyUI GPU-unlock benchmarks show BF16 gains dwarf INT8 — Acceptable_Put9983 · 2026-10-25
- Blogger revisits Kimi K3 hype, speculates China may release some B300 GPUs — lipeng0820 · 2026-10-25