Meta open-weights 816B Muse Spark Open, Apple tunes it for MLX on Mac

rohanpaul_ai · x · 2026-10-16

Meta has released open weights for Muse Spark Open, an 816B-parameter model that Apple tuned for its MLX framework and that runs on two linked Mac Studios. The MoE model routes each token to 8 of 256 experts (42B active), so each step reads only a small slice of memory. The hard part is holding the model: the 4-bit NVFP4 build needs at least 700GB of GPU memory. Each M5 Ultra Mac Studio offers up to 512GB unified memory, so two machines hold the model with 1.2TB/s of bandwidth feeding each token. It tops the MCP-Atlas benchmark.

Original post →

More from Infra

Infra channel →