Ascend SuperPOD optimization lifts DeepSeek-V4 post-training MFU to 34.22%
pmttyji · reddit · 2026-07-23
Full-parameter post-training on Ascend SuperPOD reaches 34.22% MFU
A paper on SLAI T-Rex describes an end-to-end optimization stack for full-parameter post-training of the trillion-parameter DeepSeek-V4 family on Ascend NPU SuperPOD infrastructure.
- The system tackles memory pressure, communication overhead, and kernel inefficiency across model parallelism, computation/communication orchestration, and low-level kernels.
- It reports 34.22% MFU, a 2.93× improvement over the open-source baseline recipe, while keeping training stable.
- The team also builds CPT/SFT pipelines for operations research tasks using DeepSeek-V4-Flash, combining collected domain resources with solver-verified synthetic documents.
- The resulting dataset has 10K SFT samples across four task categories and three problem representations.
- On the evaluated benchmarks, the specialized model reaches 71.81% zero-shot Pass@1, beating GPT-5.4-Mini by 3.98 points and the base DeepSeek-V4-Flash by 11.27 points.
The repo and paper present this as a full-stack path from infrastructure tuning to domain-specialized reasoning models.
Related event: Ascend SuperPOD Achieves 34.22% MFU for DeepSeek-V4 Training(3 posts)→
More from Infra
- Musk: robot RAM demand will dwarf everything else, and 100% of superintelligence compute goes to deep space — elonmusk · 2026-10-27
- RTX 5090 hits $7K as PC gaming community goes into 'denial' over AI boom — PAstynome · 2026-10-27
- Wan2GP lands on Pinokio: 1-click AI video on 6GB GPUs — cocktailpeanut · 2026-10-27
- AWS on agent prompt caching: explicit + implicit patterns to slash token costs — AWS ML Blog · 2026-10-27
- Thieves spoofing GPS steal $100M+ in data center cargo since June — Ars Technica AI · 2026-10-27
- Lam Research: weekly token usage up ~250x in 18 months — Beth_Kindig · 2026-10-27