Huawei Releases openPangu-2.0-Pro: A 505B MoE Trained Entirely on Ascend NPUs

zephyr_z9 · x · 2026-07-31

Huawei's flagship open-weight model, openPangu-2.0-Pro, has landed on Hugging Face. It features 505B total parameters, 18B active parameters per token, a 512K context window, and was trained on roughly 34T tokens.

The headline isn't the benchmarks, but the proof that a frontier-scale MoE model can be trained end-to-end entirely outside the Nvidia stack, relying solely on Huawei Ascend NPUs.

Related event: Huawei Open-Sources 505B Parameter Pangu MoE Model(3 posts)→

Original post →

More from Infra

Infra channel →