Huawei open-sources Pangu 2.0 full training stack, from pretraining to RL code
智东西 · wechat · 2026-09-28
Huawei has released the full training code for openPangu-2.0, its open-source Pangu model, covering pretraining, SFT, and post-training reinforcement learning — optimized for Ascend clusters and marking the final step of the open-source project.
The openPanguTrainingFramework supports LLMs, vision-language, and multimodal models with distributed parallelism, long-context training, mixed precision, and custom operator optimization. The RL framework openPangu-2.0-RL uses VERL as its orchestration kernel with Ascend-affine patches, enabling Actor/Rollout/Reward co-training with GSPO/GRPO.
Huawei previously open-sourced the 92B-param Flash model in June and the 505B-param Pro in July, with Ascend-native training efficiency up 30%. Downloads on AtomGit: 8.8K for Pro, 22K for Flash. The release aligns with Huawei's compute-centric, hardware-monetization AI strategy.
More from Companies & People
- Ben Thompson: The Demise of Jensen Huang Marks the End of Nvidia's Prospects and the AI Bubble — morqon · 2026-11-16
- Engineer's Interview Prep Method: Use Claude to Find Which Answers Undersell Your AI Work — brandon_galang · 2026-11-16
- DeepSeek open-sources its app frontend "chat-demo", already at 3.9k stars — NielsRogge · 2026-11-16
- CNN meme: Jensen Huang's 'imperial control' reportedly extends to the Nvidia cafeteria brisket — kevinnbass · 2026-11-16
- AI daily: DeepSeek rate-limits chats, Qwen haggling spurs shop warnings, Doubao workspace launch — 快鲤鱼 · 2026-11-16
- Satya Nadella: Code Generation Is Cheap Now, Verification Is the Hard Part — The Pragmatic Engineer · 2026-11-16