Ex-Google trainer shows MoE training across 25Gbps transcontinental link

Rohan Anil, former Google training algorithm lead, published a guide from Core Automation describing how his team trained a sparse MoE model over a 25Gbps transcontinental link between compute islands, and outlined a vision for future training in space.

2026-11-03 ~ 2026-11-03 · 3 related posts

• Rohan Anil's CoreAuto trains MoE across two global clusters over a 25 Gbps link — _arohan_ · 2026-11-03
• Training an MoE across continents on 25 Gbps: Core Automation's compute islands guide — eliebakouch · 2026-11-03
• Ex-Google Training Lead Rohan Anil Writes on Training Across Compute Islands, Even in Space — ruthstarkman · 2026-11-03