GLM-4.5-Air now supports MTP acceleration in llama.cpp
jacek2023 · reddit · 2026-08-24
A user highlights that the older GLM-4.5-Air model can now achieve significant speedups by enabling MTP (Multi-Token Prediction) in llama.cpp. It is a 106B MoE model with only 12B active parameters, making it suitable for hardware with high memory but limited compute (e.g., RTX 3090). The user provides a link to the MTP GGUF file and recommends several creative writing/RP finetunes available on Hugging Face.
More from Models
- Meta open-sources Muse Spark Open: 816B-parameter model that runs locally on two Mac Studios — gabriberton · 2026-10-16
- Grok Voice 3.0 Tops Design Arena Speech Leaderboard, Up 7.4 Points — XFreeze · 2026-10-16
- Robotics LLMs tested on 16 tasks: GPT-6 Astra hits 17.2% success vs Fable's 9.1% — pabbeel · 2026-10-16
- Meta open-sources Muse Spark: top US open model, scores just below DeepSeek — bindureddy · 2026-10-16
- TRL adds day-0 support for fine-tuning Muse Spark Open's 816B MoE with LoRA on 64 H100s — QGallouedec · 2026-10-16
- Meta's Muse Spark Open ships detailed eval docs; researcher pushes machine-readable EEE standard — evijit · 2026-10-16