Huawei Open-Sources 505B-Parameter MoE Model openPangu-2.0-Pro
langsfang · reddit · 2026-07-31
Huawei has officially open-sourced openPangu-2.0-Pro, the latest model in the Pangu series. Trained on Ascend compute, this Mixture-of-Experts (MoE) model features 505B total parameters with 18B activated parameters and a 512k context length.
The model was pre-trained on 34T tokens. For post-training, it utilizes unified SFT (combining slow and fast thinking), multiple specialist RL training, and on-policy distillation. A comprehensive technical report has also been released.
More from Models
- DeepSeek V4-Flash Hits Index Score of 50 at a Cost of Just $0.20 — xeophon · 2026-07-31
- DeepSeek V4-Flash Scores 50 on Artificial Analysis Index, 1 Point Below GLM-5.2 — MagicZhang · 2026-07-31
- V4 Flash Scores 82.7 on Terminal Bench at Just $0.28/M Tokens — jiayuan_jy · 2026-07-31
- Aged Poorly: 2 Spark's Claimed Victory Over DeepSeek V4 Flash Crumbles Overnight — TheZachMueller · 2026-07-31
- Kimi K3 Architecture Explained: Building a 2.8T Parameter Open Model via 'Active Forgetting' — AccBalanced · 2026-07-31
- DeepSeek V4-Flash Beats Pro in Agent Tests, Offers 1-Click Codex Integration — 卡尔的AI沃茨 · 2026-07-31