GGUF quantized Qwen3.8-9B-Distill lands for llama.cpp local runs
empero-ai · hf · 2026-08-19
empero-ai followed up with Qwen3.8-9B-Distill-GGUF, a quantized version for llama.cpp local deployment, with gated-deltanet architecture tags alongside distillation and reasoning. Aimed at on-device use, it's also trending on HF.
Related event: Qwen3.8-9B Distill Model Gets GGUF Release for Local Use(2 posts)→
More from Models
- Prediction: frontier AI revenue growth could slow even as AI usage keeps rising — yi111 · 2026-10-16
- Nolla Health Post-Trains Nemotron 3.5 VL: Visual Diagnosis Jumps from 35% to 66.8% — LoganGrasby · 2026-10-16
- Dev argues coding models now beat nearly all engineers in every branch of software — zack_overflow · 2026-10-16
- Prediction: Chinese frontier models could match GPT-6 by March 2027 — teortaxesTex · 2026-10-16
- Liquid AI's d1-ultra, #1 on Artificial Analysis Decision Index, lands on Vercel — JosephJacks_ · 2026-10-16
- Weekly AI roundup: Claude Haiku 5.5 cuts prices ~90%, Gemini 4 Argon output jumps to 1M tokens — DeepLearningAI · 2026-10-16