Tsinghua-spinoff Qingyi launches Ascend 950DT 10,000-GPU token factory, lifting utilization from 40% to 80%
量子位 · wechat · 2026-11-20
China's daily token consumption grew 5,000x in 2.5 years — from 100B in early 2024 to 500T by June 2026. TrendForce projects domestic chips will approach 90% of China's high-end AI chip shipments in 2026.
Tsinghua-spinoff Qingyi Intelligent, with Huawei's Ascend ecosystem and partners, launched a joint-operation plan for an Ascend 950DT 10,000-card token factory:
- Target: a leading independent domestic token factory by 2027, expanding to a 100,000-card multi-region, multi-chip network within five years.
- Four-party split: Huawei supplies chips/supernodes, IDC partners supply power and facilities, model/traffic partners supply real demand and acceptance testing, Qingyi handles software optimization, scheduling, metering, and operations. First partners include BAAI, Shanghai Dataport, China Telecom Hubei.
- Acceptance criteria "more, faster, better, cheaper": model breadth & throughput, latency & adaptation speed, accuracy & SLA, cost per million tokens.
Technical results
- Smart gateway + 4-level KVCache: up to 99% cache hit rate, utilization up from 30–40% to 80%.
- Operator optimizations: 84x speedup on a MoE op, 63.4x on LinearAttention; cluster throughput up from 40M to 140M tokens/min; P99 first-token latency cut from 180s to 40s.
- Existing base: 20+ compute centers operated, 20,000 domestic GPUs scheduled, 15+ domestic chips adapted, 10 Ascend 910C supernodes deployed.
- RSI self-evolving optimization: tens of thousands of trajectories logged, hour-level new-operator validation, day-level new-model adaptation.
More from Venture
- SarvamAI investor defends token-factory product: GPU-scarce India is quietly profiting from hosting global models — itsOmSarraf_ · 2026-11-20
- Banks refuse to lend to SpaceX, fearing the loan collateral chips would be shot into space — minhnguyen · 2026-11-20
- OpenAI's full-stack play vs Anthropic's model-as-a-service: why one bets the business on winning the model race — VraserX · 2026-11-20
- Anthropic vs OpenAI: revenue gap narrower than it looks on a gross basis — VraserX · 2026-11-20
- Anthropic IPO criticized: only 7.4% of shares floated yet valued at $1.5T — mark_k · 2026-11-20
- Anthropic's 7 cofounders reportedly sold ~23.65M shares on day one — basedjensen · 2026-11-20