Mooncake adds MUSA GPU support to unblock end-to-end tests on non-NVIDIA hardware
teortaxesTex · x · 2026-07-25
Mooncake adds MUSA build support to unblock non-NVIDIA testing
A GitHub PR adds MUSA GPU support to the Mooncake PG (ProcessGroup) module. The key reason is practical: without a working PG backend on MUSA, EP tests could only use a fallback path, which prevented meaningful validation on non-NVIDIA hardware.
The post also explains several compiler constraints that forced a refactor:
- mcc cannot parse PyTorch headers.
- It cannot handle c10d enum types like OpType or ReduceOp::RedOpType.
- Host code cannot use <<<>>> kernel launch syntax.
- MUSA lacks CUDA Graph support, so those paths must be #ifdef-ed out.
- mtbfloat16 is missing arithmetic operators, so reductions need a float accumulator.
More from Infra
- $5M Seed Round Can't Afford One DeepSeek Training Run: GPU-less AI Startup's Three Paths — FinanceYF5 · 2026-10-26
- HBM demand shifts: low-stack inference plans shelved, Rubin to go 12-high only — BenBajarin · 2026-10-26
- CircuitHub unveils The Grid, a factory-scale robot making PCBs in the US twice as fast as Shenzhen — garrytan · 2026-10-26
- Ubicloud publishes "Fixing Tool-Call Accuracy in vLLM" — petrusenko_max · 2026-10-26
- Meta approves nonvoting Class C shares as 2026 capex guidance hits $135B–$145B — thione · 2026-10-26
- Unsloth Ships MiniMax-M3.1-Flash Quants: 2-bit Retains 91.5% Accuracy, Runs in 150GB RAM — danielhanchen · 2026-10-26