SGLang ships day-0 recipes for Qwen3.8-Flash: 176B params, 6B active, verified on RTX PRO 6000 and DGX Spark
NVIDIAAI · x · 2026-09-08
Alibaba's Qwen team launched Qwen3.8-Flash (a preview of the Qwen4 architecture), and SGLang shipped day-0 deployment recipes, each verified on real hardware:
- Architecture: 176B parameters with 51B of N-gram embeddings that scale capacity at almost no extra per-token compute (6B activated per token); the embedding table sits in host memory with async prefetch instead of GPU memory
- Attention: GDN + QSA hybrid attention balances memory efficiency and precise retrieval on long-horizon tasks; Gated Residual gives 4 lanes for inter-layer information flow; trained with Muon
- Verified recipes: 1x RTX PRO 6000 (PLE table in system RAM), 1x DGX Spark (local NVMe), 2x DGX Spark with TP=2, plus NVFP4 support via RadixArk and NVIDIA ModelOpt exports
- Caveat: model support isn't in a tagged release yet — build from PR #36497; the team has fixed several issues reported by the community
More from Infra
- Ubicloud publishes "Fixing Tool-Call Accuracy in vLLM" — petrusenko_max · 2026-10-26
- Meta approves nonvoting Class C shares as 2026 capex guidance hits $135B–$145B — thione · 2026-10-26
- Unsloth Ships MiniMax-M3.1-Flash Quants: 2-bit Retains 91.5% Accuracy, Runs in 150GB RAM — danielhanchen · 2026-10-26
- Engineer with thousands of fabricated devices pours cold water on photonic crystal modulator yields — jwt0625 · 2026-10-26
- Anthropic S-1 reveals 48 cents of compute cost per dollar of Q2 revenue — nmasc_ · 2026-10-26
- Persistent AI joins UR network to route private AI inference with encrypted, IP-hidden traffic — 0xSammy · 2026-10-26