DeepSeek v4 Flash GGUF quant released for DS4 engine, doubles speed to 30+ tok/s
returnity · reddit · 2026-08-01
Developer nazeshinjite released a GGUF quantized version of DeepSeek v4 Flash (DwarfStar) with a separate DSpark MTP head. Running on the DS4 engine, it achieves over 30 tok/s on MBP M5 Max, double llama.cpp's speed, making it suitable for agentic workflows. The quant uses antirez's Q2-Q4 mixed imatrix recipe, and the author seeks community feedback for performance improvements.
More from coding & agent
- DeepMind turns coding agent Antigravity into a science tool, surfacing novel antimicrobial peptide in one session — pushmeet · 2026-10-16
- Cross-review coding workflow: Claude writes the plan, Codex audits it — theteknosaur · 2026-10-16
- Simon Willison: code mode is the future of tool calling, if it can be sandboxed — springrod · 2026-10-16
- Normalizing Claude's schema-free MCP output before it hits downstream n8n nodes — snowingbol · 2026-10-16
- Agent named 'Ilya' reportedly scores 1.1pt higher on benchmarks — daniel_mac8 · 2026-10-16
- A plain notes.md fixed my agent's cross-session amnesia better than chat history — rahul_watertech · 2026-10-16