Exo Labs claims 4.8 TB/s memory bandwidth from clustered Mac Studios, scaling linearly
anonmt57 · reddit · 2026-08-29
Exo Labs is making striking claims: with their RDMA clustering solution, M5U Mac Studio clusters achieve 4.8 TB/s memory bandwidth that scales linearly with nodes. One of their employees said in a localllm thread that latency, not bandwidth, is what matters in their setup.
The poster notes that when the community previously weighed "two clustered 96GB M5U vs one 256GB," most recommended the single machine because of TB5 bandwidth limits — many were unaware of Exo's claims. He's keeping his 256GB order for agility (a second 256GB Studio could later scale both compute and RAM), but thinks the 96GB cluster route is worth considering.
More from Infra
- Qwen3.8 IQ1_S on RTX 5070: Achieving 22t/s with 12GB VRAM — jacek2023 · 2026-08-29
- Apodex Launches Frontier Program Offering $100k Monthly Compute Credits — Scobleizer · 2026-08-29
- Solo researcher boosts Qwen 3.8 on Mac: +54% decode at 147k context — julianharris · 2026-08-29
- Lightning AI deploys H200s and launches VMs early access — LightningAI · 2026-08-29
- Open Source Personal AI Datacenter with Full Guides — dee_hw · 2026-08-29
- Nvidia's AI edge is moving beyond the GPU with smarter data center traffic control — TechCrunch AI · 2026-08-29