Ascend 950 FP8 training decoded: ~217-279 TFLOPS per NPU vs DeepSeek's 385 on H800

teortaxesTex · x · 2026-11-21

Huawei published openPangu FP8 low-precision training results on the Ascend 950 super node, claiming <0.16% loss error, 51% MFU, and 24% speedup over BF16, with plans to open-source the stack. But teortaxesTex breaks down what the numbers actually mean: the 51% MFU is relative to the BF16 peak. The 950DT advertises 547 TFLOPS at the top 36-Cube-Core bin (486 and 425 on lower bins), implying a realistic 217-279 TFLOPS per NPU — versus the 385 TFLOPS DeepSeek achieved on H800s back in 2024. Attached slides show a 1024-card run with 64-way expert parallelism and sequence length 4096.

Related event: Huawei Ascend 950 FP8 training results spark MFU dispute(2 posts)→

Original post →

More from Infra

Infra channel →