Running local LLMs on an M5 Pro 64GB: ~20 tok/s on Qwen 27B, DS4 Flash at just 8 tok/s
rJohn420 · reddit · 2026-09-13
A Reddit user shares real-world local inference numbers on an M5 Pro with 64GB RAM: around 20 tok/s sustained on Qwen 3 27B (about 30 tok/s in the first 2-4k tokens), but heavy thinking makes it feel slow. Trying antirez's DS4, DeepSeek V4 Flash drops to roughly 8 tok/s sustained — effectively unusable. The thread asks what others run on the same hardware.
More from Infra
- Would LITE accepting MRVL's merger offer prove its moat was overstated? — BenBajarin · 2026-10-30
- Claymation body horror on 8GB: three wrong settings, not the GPU, made local renders slow — roro9- · 2026-10-30
- durable-object-migrator: zero-downtime exports for Cloudflare Durable Objects — samgoodwin89 · 2026-10-30
- An unnamed firm already runs a fairly scaled dedicated vehicle for compute lending, says analyst — matt_slotnick · 2026-10-30
- GPU break-even throughput vs open-weight token prices up 25-83% since May — bookwormengr · 2026-10-30
- Sam Altman says the chip supply chain's invisible hand is failing — and DRAM is why — SnoozeDoggyDog · 2026-10-30