Qwen4 training now: Alibaba teases Max/Flash/Plus variants, 5-10T params for Qwen4.5-5
ChrisGPT · x · 2026-09-22
Community reports from Alibaba's Apsara Conference clarify the Qwen roadmap and correct earlier mix-ups between Qwen4 and the Qwen4.5-5 plans:
- Alibaba's public August 26 architecture preview already includes qwen4exp / Qwen4ExpForConditionalGeneration, with hybrid linear/sparse attention, gated residual streams, N-gram lookup tables offloadable to system RAM, and Muon-based training
- Qwen4-Max, Qwen4-Flash, Qwen4-Plus and Qwen4-27B are coming; Qwen4 is currently training
- The 5-10 trillion parameter scaling target applies to future Qwen4.5 and Qwen5, not Qwen4
- Alibaba demoed recursive self-improvement on Qwen3.8-Max: 33 automated iterations over a month lifted its Artificial Analysis score from 40 to 45; the broader roadmap targets long-running complex tasks and progress toward ASI
More from Models
- Datalab claims parsing accuracy second only to Gemini at 1/37 the cost and 6x speed — VikParuchuri · 2026-11-12
- Datalab fast-mode OCR beats Opus 5.5 and GPT-6.1 Sol at 1/4 to 1/68 the price — VikParuchuri · 2026-11-12
- Claude's world knowledge impresses: model guesses user identity from one prompt — adonis_singh · 2026-11-12
- Gemini 4 Carbon opens to all at $2/$10, price doubling to $4/$20 on Dec 1 — socialwithaayan · 2026-11-12
- Ten wild Gemini 4 Carbon demos in 24 hours: CUDA meadows, V8 engines, mech stomps — socialwithaayan · 2026-11-12
- How to cut Fable 5.2 token costs by 90%: Arc routing plus a lean CLAUDE.md — EXM7777 · 2026-11-12