Running DeepSeek V4 Flash on 64GB Macs: 8 tok/s Decode After llama.cpp Patches
memeka · reddit · 2026-08-13
A developer successfully ran DeepSeek-V4-Flash-0731 on an M1 Max 64GB MacBook. By patching llama.cpp, using IQ3-XXS quantization (104GB), and limiting context to 64k, they achieved 8 tok/s decode and 30 tok/s prefill, performing much better than expected.
More from Infra
- Dev publicly asks neoclouds for discounts on a $30k GPU compute purchase — Sauers_ · 2026-10-16
- New hardware day: local LLM deployment the moment it arrives — lxfater · 2026-10-16
- Together AI's score centering fixes RL training collapse under quantized inference — nrehiew_ · 2026-10-16
- Inference is splitting prefill and decode across specialized chips, not just H100s — AccBalanced · 2026-10-16
- Rebasely launches in beta: Git hosting built for humans and coding agents — handotdev · 2026-10-16
- Drama3 TTS lands in audio.cpp: up to 5x real-time on RTX 5090, <8GB VRAM mode too — Acceptable-Cycle4645 · 2026-10-16