Exo Labs claims 4.8 TB/s memory bandwidth from clustered Mac Studios, scaling linearly
anonmt57 · reddit · 2026-08-29
Exo Labs is making striking claims: with their RDMA clustering solution, M5U Mac Studio clusters achieve 4.8 TB/s memory bandwidth that scales linearly with nodes. One of their employees said in a localllm thread that latency, not bandwidth, is what matters in their setup.
The poster notes that when the community previously weighed "two clustered 96GB M5U vs one 256GB," most recommended the single machine because of TB5 bandwidth limits — many were unaware of Exo's claims. He's keeping his 256GB order for agility (a second 256GB Studio could later scale both compute and RAM), but thinks the 96GB cluster route is worth considering.
More from Infra
- Google expands Android Earthquake Alerts from 98 to nearly 200 countries after 1B+ alerts — sundarpichai · 2026-10-16
- Microsoft's Magnetar zkVM proves programs 10-39x faster using only standard hash functions — Microsoft Research · 2026-10-16
- Moving 1PB back on-premises costs a fortune as AI training drives cloud repatriation — DavidLinthicum · 2026-10-15
- FP8 + DSpark stack delivers ~2x speedup for Nemotron 3.5 Super VL on H100s — vllm_project · 2026-10-15
- Nemotron 3.5 Super VL hits ~630 tokens/s at 100k-token prompts, fastest 20+ score model measured — ArtificialAnlys · 2026-10-15
- vLLM Ships Day-0 Support for Nemotron 3.5 Super VL with NVFP4 on a Single GB200 — vllm_project · 2026-10-15