Apple Runs Near-Trillion-Parameter Model on 4 Mac Studios at 36 Tokens/s
Apple's MLX team demonstrated running the near-trillion-parameter open model Muse Spark Open (816B) locally on a cluster of four M5 Ultra Mac Studios using MLX and Thunderbolt-based RDMA, achieving over 36 tokens per second in decoding.
2026-10-16 ~ 2026-10-16 · 3 related posts
- Episode 1: Meta Open-Sources Muse Spark Open, Its Strongest US Open-Weights Model(2026-10-16, 62 posts)
- Episode 2: Meta Open-Sources 816B MoE Model Muse Spark Open; Baseten Offers Day 0 API(2026-10-16, 2 posts)
- Episode 3: vLLM and Inferact Optimize Muse Spark Open Serving(2026-10-16, 2 posts)
- Episode 4: Apple Runs Near-Trillion-Parameter Model on 4 Mac Studios at 36 Tokens/s(2026-10-16, 3 posts)
- Apple runs near-trillion-parameter Muse Spark Open on 4 M5 Ultra Macs at 36.7 tok/s — EAccelerate_42 · 2026-10-16
- Apple MLX Runs 816B Muse Spark Open at 36+ Tokens/s on Four Mac Studios — andrejusb · 2026-10-16
1 near-duplicate retellings: rxwei