Mac local inference survey: dense 27B remains the go-to for coding
DotaMate · reddit · 2026-10-22
A Reddit thread asks which open models people actually run on Apple Silicon MacBooks: Qwen3.8-Flash-Next, Qwen 35B, the dense 27B, or Nemotron Bolt. The author keeps coming back to the 27B for coding. He is building Kapitsa, an Apache 2.0 open-source project that works across all M chips (M1 through M5 Ultra), and has achieved SOTA decode and prefill performance for Qwen 35B/27B on his M4 Pro.
More from Infra
- BIND9 hit by high-severity GSS-TSIG replay bug enabling potential RCE (CVSS 8.1) — basedjensen · 2026-10-22
- Who priority-parks background agents? An ops veteran on sharing one 16GB GPU between apps and agents — Powermadlux · 2026-10-22
- Gartner: AI data centers need $8.5T revenue by 2030 but will only make $3.6T — AIFlow_ML · 2026-10-22
- FlashAttention 4 on GB300 Is So Fast It Annoys Performance Researchers — francoisfleuret · 2026-10-22
- Comment: Larry Page worth $300B won't pay 5% of net worth for infrastructure he profited from — georgemillo · 2026-10-22
- Amazon reportedly buying $5B of Nvidia GB300 racks it can't yet power on — AIFlow_ML · 2026-10-22