DeepSeek-V4-Flash hits 51.5 tok/s on M3 Ultra
antirez · x · 2026-08-27
Developer Ivan Fioravanti continues optimizing DeepSeek-V4-Flash inference on M3 Ultra via DwarfStar, boosting speed from 45.7 to 51.5 tok/s (+12.6%).
Key Details:
- Applies Q80 to Q4K quantization for attention+head (not mathematically 1-1 with mxfp4).
- Quality Gate: 85/92 on full eval (vs 82/92 baseline); AIME score improved to 22→24/25.
- Attempting to recover CompSec using imatrix calibration.
- Code branch is on GitHub; Hugging Face model release pending.
More from coding & agent
- AI software factories hinge on the Factory Loop, not faster code generation — Pavan_Belagatti · 2026-10-16
- 'Dropping a 3,000-line PR twenty minutes after ticket assignment' — AI coding meme goes viral — facontidavide · 2026-10-16
- Self Labs launches Agent Vault to let AI agents log in and pay with credit cards — EXM7777 · 2026-10-16
- Plane Agents: triggers, not prompts, are what turn chatbots into workflow agents — JosephJacks_ · 2026-10-16
- Claude eng lead Felix Rieseberg publishes tutorial on being more ambitious with AI — danshipper · 2026-10-16
- Qwen Code Desktop v0.25.2 ships managed-agent fixes and MCP config repair — github-actions[bot] · 2026-10-16