ISTA-DASLab ships GSQ-RCO quantized DeepSeek-V4.1-Flash GGUFs, llama.cpp support still pending
Gold_Coconut9777 · reddit · 2026-10-24
ISTA-DASLab released GGUF quantizations of DeepSeek-V4.1-Flash-1017 using its GSQ-RCO smart quantization approach, now available on Hugging Face (ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF).
Caveats:
- llama.cpp is not yet supported: the architecture-support PRs (#28696, #30817) remain unmerged;
- The model card mentions Strata support, but the poster notes original Strata likely only supports Qwen3.8-Flash-Next, so it probably refers to Strata-based forks like Xolotl or Maya.
More from Infra
- What $70-100K of hardware buys for local GLM5.3 and DeepSeek with 10-20 concurrent users — whoami-233 · 2026-10-24
- Stripe reportedly buying OpenRouter for ~$7.5B as AI usage billing becomes the prize — FinanceYF5 · 2026-10-24
- Redditor pushes back on local AI FUD: real inference speeds are 5x what the video shows — wojtek15 · 2026-10-24
- NVIDIA ships BioNeMo Inference Runtime v0.2 with RFD4-Proteina support — AllThingsApx · 2026-10-24
- Sauers_ Mocks OpenAI Over Unstudied Multi-Agent Hardware — Sauers_ · 2026-10-24
- Local quant benchmark: new releases trail months-old DeepSeek/Qwen models — EmilPi · 2026-10-24