GLM-5.3-Flash 320B served from two Mac Studios: 137 tok/s single-user, 32 users, zero errors

AIFlow_ML · x · 2026-11-23

Developer @sashmit ran the 320B GLM-5.3-Flash on two M5 Ultra 512GB Mac Studios connected by a single Thunderbolt 5 cable:

Takeaway: a desk setup can now serve a frontier-size MoE to 32 people — no server room required. Figures are source-measured, not re-run. Source: AIFlowML on X.

Original post →

More from Infra

Infra channel →