China Telecom open-sources Xing4.0-29B MoE, first in class trained fully on Ascend NPUs
Skyline34rGt · reddit · 2026-09-17
China Telecom AI has released Xing4.0-29B-A4B on Hugging Face, the next-gen model of its Xing series (formerly TeleChat): a 29B-total-parameter MoE with only 4B active per token.
Key points
- Architecture: mHC + MLA + MTP, native 256K context (extensible to 512K), 64 routed experts + 1 shared expert, designed for multi-step planning, tool calling, and agent workloads.
- Domestic training: claimed first model at this scale trained entirely on Ascend 910C clusters with MindSpore; co-optimizations (MoE communication, selective recomputation, DVM graph-operator fusion, Ascend C fused kernels) boosted training throughput 96% over out-of-the-box.
- Ecosystem: fine-tuning via LLaMA-Factory/MindFormers, inference via SGLang/vLLM/KTransformers, and adaptation for agent frameworks like OpenCode and Claude Code.
- Benchmarks: SWE-bench Verified 75.0, Terminal-Bench 2.1 57.5 (beating compared Gemma4-26B-A4B), AIME2026 90.0, roughly on par with Qwen3.6-35B-A3B overall.
More from Infra
- Speculative decoding: small draft model proposes tokens, big model verifies in one pass — HowDevelop · 2026-09-17
- India to invest roughly $30 billion in building a domestic semiconductor industry — Polymarket · 2026-09-17
- Dev Inspired by AgentConf Keynote to Run All Agents Locally on Home Blackwell GPU Stack — TejasKumar_ · 2026-09-17
- DeepSeek-V4.1 Flash deep dive: pushing KV cache compression to the limit at 420 tok/s — teortaxesTex · 2026-09-17
- Four Scheduling Techniques Flatten MoE Training Memory Peaks, Enabling 1M Context at 10.4x Throughput — Shrey Pandit · 2026-09-17
- GLM agent built its own inference infra in two weeks, tripling end-to-end throughput — jietang · 2026-09-17