Quantized MacBook Nearly Matches DGX Spark
anvarazizov · reddit · 2026-07-18
The author used Terminal-Bench 2.1 and Terminus-2 to compare two local systems running DeepSeek-V4-Flash:
- 1 M5 Max MacBook: Highly quantized 80.8 GiB GGUF at roughly 2.45 bit/weight
- 2× DGX Spark: Native FP8/FP4 checkpoint with DSpark speculative decoding
Results show:
- MacBook: 47/87 = 54.0%
- 2× DGX Spark: 45/86 = 52.3%
- Out of the 86 tasks scorable on both sides, they reached identical conclusions on 66 of them
- There were 20 disputed tasks: 11 Mac-only and 9 Spark-only
The author emphasizes that this does not prove 2-bit quantization is a "free lunch" because the variables were not strictly controlled: hardware, KV format, context limits, runtime, and Spark's speculative decoding all differed. More accurately, this is an end-to-end comparison of two "complete systems" rather than a pure quantization ablation.
More from Infra
- Analyst: Ant has the most fungible AI workload of any model provider today — BenBajarin · 2026-10-26
- Anthropic S-1: training infra edge cut per-task cost 40% and doubled revenue growth — BenBajarin · 2026-10-26
- Rewriting scaling law study: optimal synthetic data share rises from 10% to 32% with compute — heghbalz · 2026-10-26
- US states halt new data centers as 72% of Americans oppose local builds — YvesMulkers · 2026-10-26
- $5M Seed Round Can't Afford One DeepSeek Training Run: GPU-less AI Startup's Three Paths — FinanceYF5 · 2026-10-26
- HBM demand shifts: low-stack inference plans shelved, Rubin to go 12-high only — BenBajarin · 2026-10-26