Alibaba and Moonshot Target 10T Parameter Models, Hitting Memory Bottlenecks
pstAsiatech · x · 2026-08-12
As Qwen and Kimi teams push model sizes toward the 10-trillion (10T) parameter range, Alibaba's new generation SuperNode must scale to support them. Even at FP8 precision, running 10T models presents massive challenges.
Comparing the currently scaling Zhenwu M890 SuperNode with NVIDIA's GB300 NVL72, both systems will hit a physical memory capacity bottleneck before reaching their compute limits when supporting next-generation massive models.
More from Infra
- Nvidia Is Speedrunning the Creation of a Synthetic Hyperscaler — firstadopter · 2026-08-12
- Expert: 6-Inch Wafers Won't Entirely Solve Optical Comm Scaling Challenges — BenBajarin · 2026-08-12
- AI Compute Boom Drives TL20 Tech Stocks Up 59% Year-to-Date — TiernanRayTech · 2026-08-12
- How Vercel Migrated Its Core Database Handling 6,000 Deployments Per Minute — evilrabbit_ · 2026-08-12
- Analyst: Server CPU Market Bracing for Unprecedented S-Curve Leap — BenBajarin · 2026-08-12
- ComfyUI Workflows Crawl on 128GB DGX Spark vs RTX 4090 — jungseungoh97 · 2026-08-12