Training frontier models across scattered <20MW data centers sparks moat debate
Rohan Anil detailed training a MoE model across two continents over a 25Gbps link, prompting Arohan to argue that federated <20MW data centers can train frontier models, leaving physical space and power siting as the only remaining moat.
2026-11-05 ~ 2026-11-05 · 3 related posts
- Episode 1: Rohan Anil shows MoE training across continents over 25Gbps links(2026-11-03, 6 posts)
- Episode 2: Training frontier models across scattered <20MW data centers sparks moat debate(2026-11-05, 3 posts)
- Frontier training without megacampuses: MoE model trained across <20MW clusters over 25Gbps — _arohan_ · 2026-11-05
- Arohan: if training has any moat, it's space itself — _arohan_ · 2026-11-05
1 near-duplicate retellings: _arohan_