Huawei compute limits leave 800B-model training far out of reach, industry source says
ShakeelHashim · x · 2026-07-23
A commenter quotes an industry call saying the gap with the U.S. is fundamentally about compute resources, not just talent or model capability.
- Training a model “as large as theirs” would require about 50,000 GB300s or Huawei 950s, or 200,000 cards.
- The speaker says current resources are only enough to do more experiments at around the 10B-active scale, and that training an 800B model is still far off.
- The bottleneck is framed as compute on both sides: cards can’t be bought domestically, and capital investment is lower than the U.S.
- A highlighted line says the problem is “basically unsolvable” right now because Huawei’s output is also limited, and training an 800B model would need 200,000 of Huawei’s newest cards.
Related event: Leaked Call Claims DeepSeek Operates with ~20K H100 GPUs(3 posts)→
More from Infra
- DeepSpeed shows AutoEP/AutoTP/AutoSP parallelism gains, hosts office hours — PyTorch · 2026-10-27
- Running a local 9B as a coding agent: brief the big model to plan, let the small model execute — Electrical_Ninja3805 · 2026-10-27
- Cloudflare Durable Objects validated as top architecture for AI agent WebSocket servers — tristanbob · 2026-10-27
- Gary Marcus: With Q3 data added, Anthropic's compute-efficiency growth shows deceleration — GaryMarcus · 2026-10-27
- SpaceX locks in $40B GPU financing deal with Apollo, the largest ever committed — TechCrunch AI · 2026-10-27
- Inference is just Kubernetes with a multi-trillion-dollar market, and the communities overlap — matt_slotnick · 2026-10-27