Best setup to run Qwen3.8 27B locally on an M4 Pro 48GB Mac?
9kSs · reddit · 2026-10-25
A Reddit user asks for the optimal way to run Qwen3.8 27B on an M4 Pro 48GB Mac, balancing throughput (tps), time-to-first-token, context length, and headroom for other tasks. Community opinions conflict on MTP, MLX, and quantization choices; the poster rules out anything below 10 tps.
More from Infra
- ByteDance, Alibaba and Tencent order 3M+ Nvidia RTX PRO 5500 cards worth $35B+ — Miles_Brundage · 2026-10-25
- Nebius hits 67B tokens/day on OpenRouter, but rivals process up to 2T daily — AccBalanced · 2026-10-25
- OpenRouter analysis finds evidence of spoofing-style price manipulation by inference providers — AccBalanced · 2026-10-25
- EmbeddedLLM receives AMD MI350X server donation to advance vLLM ROCm work — AccBalanced · 2026-10-25
- 106 Tesla Megapacks to replace a former Belgian coal plant with 400 MWh storage — XFreeze · 2026-10-25
- Running Qwen 3.8 Flash Next on 2x CMP 170HX mining GPUs, config shared — leonbollerup · 2026-10-25