4x 256GB M5 Ultra Mac cluster with exo serves 32 users at 2000 tok/s on Qwen 27B

StefanoGogioso · x · 2026-11-19

At Supercomputing 2026 (with SHI / Apple), exo labs demonstrated a cluster of 4x 256GB M5 Ultra Macs running exo distributed inference: 2000 tok/s aggregate throughput on Qwen 3.8 27B while serving 32 concurrent users at 62 tok/s each. Photos show stacked Mac Studio units at the show floor booth.

Original post →

More from Infra

Infra channel →