Qwen3.8 Open-Sources 2.4T Parameter MoE Flagship Model
togethercompute · x · 2026-08-14
Alibaba's Qwen team has launched their new open-weight flagship model, Qwen3.8-2.4T-A95B, now available on Together AI.
The model uses a sparse Mixture-of-Experts (MoE) architecture with 2.4 trillion total parameters and 95 billion active parameters. Key features include:
- Multimodal Support: Qwen's first multimodal model above one trillion parameters, processing both text and images.
- Long Context: Supports a 256K context window with up to 128K output tokens.
- Coding & Agentic Focus: Optimized for coding and long-horizon agentic tasks.
- Adjustable Reasoning: Features always-on thinking with adjustable effort levels across low, high, and xhigh.
More from Models
- Unverified claim: Apple and Meta's 816B-parameter Muse Spark Open runs on two Mac Studios — TansuYegen · 2026-10-16
- Gemini 4 model card: model eliminated months of trial-and-error on bioweapons research — Puzzleheaded-King584 · 2026-10-16
- Every AI picks 7: Anthropic engineer's rule for escaping model taste convergence — rubenhassid · 2026-10-16
- Brain teaser: strip all attention, MLP and embedding matrices from a Llama 3 — how many trainable params remain? — Sauers_ · 2026-10-16
- Lean v4.35.0 ships verified kernels — one written and proven consistent by Claude — geoffreyirving · 2026-10-16
- One flagged seat froze an entire Claude team org — founders share backup plans — RexDouglass · 2026-10-16