Can DeepSeek v4.1 actually run at 1-3 bpw? Reddit locals debate ultra-low quant usability
Plastic-Stress-6468 · reddit · 2026-10-28
A Reddit user asks whether anyone is genuinely using DeepSeek v4.1-1017 at 1-3 bpw on affordable hardware, beyond treating it as a novelty. They recall v4-0731's Q2 being a shadow of its Q8 self, which itself was mostly QAT-derived. They're soliciting real-world experiences, especially versus models like 3.8FN at higher quants.
More from Infra
- HUMAIN details site and power groundwork behind its AI infrastructure buildout — HUMAIN · 2026-10-28
- llama.cpp PR fuses MoE matmuls and GLU, boosting Qwen3 CUDA throughput up to 17% — jacek2023 · 2026-10-28
- A 5-minute visual explainer of what happens when you call an LLM API — HowDevelop · 2026-10-28
- GenieX brings any GGUF model to Snapdragon's Hexagon NPU, with real benchmarks — SkyFeistyLlama8 · 2026-10-28
- Cached tokens explained: how prefix caching cuts agent costs to 2% and what breaks the hit rate — Arindam_1729 · 2026-10-28
- Hojo-TTS-Light: open-source 40M/80M TTS benchmarked on a 2-core CPU, no GPU — HeyZoyaKhan · 2026-10-28