Exo Labs claims 4.8 TB/s memory bandwidth from clustered Mac Studios, scaling linearly
anonmt57 · reddit · 2026-08-29
Exo Labs is making striking claims: with their RDMA clustering solution, M5U Mac Studio clusters achieve 4.8 TB/s memory bandwidth that scales linearly with nodes. One of their employees said in a localllm thread that latency, not bandwidth, is what matters in their setup.
The poster notes that when the community previously weighed "two clustered 96GB M5U vs one 256GB," most recommended the single machine because of TB5 bandwidth limits — many were unaware of Exo's claims. He's keeping his 256GB order for agility (a second 256GB Studio could later scale both compute and RAM), but thinks the 96GB cluster route is worth considering.
More from Infra
- Jensen Huang joins BG2 podcast: does AI revenue justify capex, '27 bottlenecks — elonmusk · 2026-10-16
- Mistral's on-device infra rack revealed: DGX Spark, Mac Studio and more — gregmushen · 2026-10-16
- NVIDIA and Sweden's Wallenberg launch Sferical One, a shared AI supercomputer — nvidia · 2026-10-16
- Next infra frontier: self-evolving systems that adapt and self-verify — _shreya_s · 2026-10-16
- Xiaomi's MiMo RL dashboard reveals $3.47M spent on just 30 training steps — bycloud · 2026-10-16
- Cerebras pushes disaggregated inference: heterogeneous prefill pools feeding wafer-scale decode — ai · 2026-10-16