Qwen3.8-27B runs at 63 tok/s on Mac Studio

remilouf · x · 2026-08-17

A user shared a benchmark of running the Qwen3.8-27B model locally on a Mac Studio, achieving an inference speed of 63 tokens per second, noting that it is very usable.

Related event: Qwen3.8-27B matches top closed-source models on benchmarks while running on a single consumer GPU(20 posts)→

Original post →

More from Infra

• First AA-AgentPerf results: NVIDIA Vera Rubin NVL72 delivers up to 5.7x throughput per MW vs GB300 — ArtificialAnlys · 2026-10-16
• Vera Rubin NVL72 first benchmarks: up to 5.7x throughput per MW vs GB300 — ArtificialAnlys · 2026-10-16
• NVIDIA Vera Rubin NVL72 hits up to 5.7x GB300 throughput per MW on agent benchmark — ArtificialAnlys · 2026-10-16
• 14 open-source LLM observability tools to know in 2026, from Langfuse to Laminar — TheTuringPost · 2026-10-16
• Local AI is a routing problem, not a privacy feature: where each task should run — bigdata · 2026-10-16
• Moving agent work from GPUs to CPUs for durable, predictable actions — cramforce · 2026-10-16

Infra channel →