Qwen3.8 Distilled 9B/4B/2B Released: MMLU Scores Double
alejandroll10 · x · 2026-08-17
Community releases distilled models based on Qwen3.8-2.4T-A95B in 9B/4B/2B sizes. Via full-parameter SFT on curated teacher CoT, capabilities improved significantly: 9B MMLU rose from 54.6 to 75.1, 4B from 35.4 to 55.3, and 2B from 28.3 to 54.8. Weights and GGUF formats are available.
More from Models
- Prediction: frontier AI revenue growth could slow even as AI usage keeps rising — yi111 · 2026-10-16
- Meta teased 816B-param open-weight Muse Spark Open with 1M context, says meme thread — alexandr_wang · 2026-10-16
- Nolla Health Post-Trains Nemotron 3.5 VL: Visual Diagnosis Jumps from 35% to 66.8% — LoganGrasby · 2026-10-16
- Dev argues coding models now beat nearly all engineers in every branch of software — zack_overflow · 2026-10-16
- Prediction: Chinese frontier models could match GPT-6 by March 2027 — teortaxesTex · 2026-10-16
- Liquid AI's d1-ultra, #1 on Artificial Analysis Decision Index, lands on Vercel — JosephJacks_ · 2026-10-16