Moonshot Open-Sources MoonEP: Expert Parallelism Library for Perfect Load Balancing
SeunghyunSEO7 · x · 2026-07-28
Moonshot AI officially open-sourced MoonEP, an Expert Parallelism (EP) communication library. Its core highlight is achieving perfect load balancing across ranks via dynamic redundant experts, ensuring every rank receives exactly S × K tokens regardless of routing skew.
Technical Details:
- Online Planning: Features a near-optimal GPU planning kernel with negligible overhead.
- Zero Copy & Static Shapes: Fused permute/unpermute operations.
- Underlying Optimization: Adopts Sonic MoE's recomputation and backprop math (contributed by Tri Dao).
More from Infra
- Dedicated Hardware for Running AI Agents at Scale Arrives — cyrilzakka · 2026-09-23
- Ternary Bonsai 2 27B: 5.9GB weights retain ~95% of full-precision reasoning — cephaloform · 2026-09-23
- Qwen 27B runs 24hr unattended on one RTX5090, builds full Postgres-SpringBoot-React spreadsheet app — anglepoiselife · 2026-09-23
- OpenRoboto Shift launches: decentralized egocentric video data network for robot brains — markjeffrey · 2026-09-23
- Engineer describes designing digital circuits that recycle most of their energy — MikePFrank · 2026-09-23
- Cloudflare CTO Dane Knecht makes TIME's 2026 executives list as AI crawlers hit 52% of traffic — dinasaur_404 · 2026-09-23