Pangu vs DeepSeek V3 training cost gap: partly skill issue, partly method

teortaxesTex · x · 2026-11-21

A technical thread adds caveats to Pangu vs DeepSeek V3 training cost comparisons: Pangu is 505B params (18B activated) vs V3's 671B (37B), and may be inherently trickier to train. Pangu's step time also includes the costlier Muon optimizer plus mHC and SWA. The author still suspects the original figures may be a large overestimate.

Original post →

More from Infra

Infra channel →