Moonshot open-sources MoonEP for balanced MoE expert parallelism
SeunghyunSEO7 · x · 2026-07-28
MoonshotAI has open-sourced MoonEP, an expert-parallelism communication library for keeping token loads balanced across ranks.
- It uses dynamic redundant experts to make every rank receive exactly S × K tokens, regardless of routing skew.
- The library plans redundant experts online from the current router outputs and prefetches them before expert computation.
- A GPU planning kernel handles this with negligible overhead.
- It emphasizes zero-copy and static shapes, aiming at efficient MoE execution and lower activation-memory pressure.
Related event: Moonshot Open-Sources MoonEP for MoE Expert Parallelism Communication(8 posts)→
More from Infra
- Amazon Makes Largest-Ever Donation to Lean FRO for Mathematically Proving AI Agent Behavior — ChrSzegedy · 2026-07-28
- LangChain says open source is in its blood as it partners with NVIDIA — Hacubu · 2026-07-28
- Morgan Stanley maps the AI infrastructure stack and who gets paid at each layer — SumitGup · 2026-07-28
- Google Cloud adds spend caps and sandboxes for untrusted agent workloads in Cloud Run — steren · 2026-07-28
- A Fields Medalist joins OpenAI as $250B data-center financing and Kimi K3 land — Dapper-Tale-4021 · 2026-07-28
- Bloomberg map shows Nvidia at the center of circular AI financing — SumitGup · 2026-07-28