Qwen2.5 2B runs on phones with 1GB RAM; MMLU jumps to 54.8
alexcovo_eth · x · 2026-08-17
The distilled Qwen2.5 2B model runs on devices with just 1GB RAM (Q4KM). It features 262k context, function calling, and full-parameter SFT. Benchmarks show significant gains: MMLU CoT increased from 28.3 to 54.8, and GSM8K from 33 to 64.
More from Models
- Prediction: frontier AI revenue growth could slow even as AI usage keeps rising — yi111 · 2026-10-16
- Meta teased 816B-param open-weight Muse Spark Open with 1M context, says meme thread — alexandr_wang · 2026-10-16
- Nolla Health Post-Trains Nemotron 3.5 VL: Visual Diagnosis Jumps from 35% to 66.8% — LoganGrasby · 2026-10-16
- Dev argues coding models now beat nearly all engineers in every branch of software — zack_overflow · 2026-10-16
- Prediction: Chinese frontier models could match GPT-6 by March 2027 — teortaxesTex · 2026-10-16
- Liquid AI's d1-ultra, #1 on Artificial Analysis Decision Index, lands on Vercel — JosephJacks_ · 2026-10-16