Running 284B DeepSeek on 64GB MacBook: Lossless quality confirmed
cowboy-bebob · reddit · 2026-08-22
Notes on running DeepSeek-V4-Flash (284B) on a 64GB MacBook:
- Memory: Model is 165GB. Runs via partial weight loading and SSD offloading.
- Quality: No quality drop. Perplexity score 6.1250 vs official 6.1262.
- Speed: 11 tps for 2-bit, 1-2 tps for higher quality.
- Cache: 8GB cache was faster than 32GB. macOS native file caching outperforms app-level allocation.
- Optimizations: Speculative decoding and prefetching slowed it down due to disk bottleneck.
Code, logs, and failed experiments are available in the repo.
More from Infra
- Cloudera launches Anywhere Cloud platform focusing on agents and data sovereignty — DavidLinthicum · 2026-08-22
- On-prem MLOps in a hospital: monitoring self-built and vendor models — zentax2001 · 2026-08-22
- Agent workloads prioritize per-thread performance over core count, says Daytona.io — BenBajarin · 2026-08-22
- Optics Won’t Scale as Fast as Market Expects: Manufacturing Constraints — BenBajarin · 2026-08-22
- Nvidia uses linear algebra to fix cross-model KV cache transfer, 25x faster — bendee983 · 2026-08-22
- Anthropic hires former Google TPU head Amir Salek to boost in-house chip development — nmasc_ · 2026-08-22