Running Qwen3.6-35B on a 16GB Mac
Senior_Nothing_4998 · reddit · 2026-07-18
This article details how the author extended antirez's ds4 runtime with a Metal backend to run Qwen3.6-35B-A3B on a 16GB M1 Pro.
The core challenge is that the Q4KS model size (20.8GB) exceeds the machine's 16GB capacity. To solve this, DS4 maintains a bounded routed experts cache within the unified memory and streams missing expert weights directly from the SSD.
Benchmark results on the M1 Pro 16GB show that the production build's four-run warm median achieved prefill 15.04 tokens/s and generation 9.77 tokens/s. Memory pressure remained normal, with no increase in swapout counts. The repository includes the runtime, ExpertMajor GGUF layout and converter, benchmark details, and links to the released GGUF files. While still experimental, the author confirms it is fully usable on a real 16GB machine.
More from Infra
- SkyPilot exits stealth with $20M seed round and an AI compute platform for fragmented clouds — jfiance · 2026-07-22
- Nothing phone mockup turns a film joke into a modular design meme — ZeYanjie · 2026-07-22
- Actual Computer says its inference stack is tuned for Nvidia’s consumer Blackwell lineup — markjeffrey · 2026-07-22
- Ben Bajarin says CPU demand is still being badly underestimated — BenBajarin · 2026-07-22
- An energy model says the U.S. could run short of natural gas starting in 2028 — churchkey · 2026-07-22
- Devin adds e2b sandboxes for remote agent execution — badphilosopher · 2026-07-22