llama.cpp new command: one-liner enables MTP speculative decoding
ggerganov · x · 2026-08-15
Georgi Gerganov, author of llama.cpp, demonstrated a simple command on X: llama serve -hf ggml-org/Qwen3.8-27B-GGUF --spec-type draft-mtp to enable MTP (Multi-Token Prediction) speculative decoding. This simplifies the workflow for using speculative decoding, which is practical for optimizing local inference performance.
Related event: llama.cpp Adds One-Command MTP Speculative Decoding(2 posts)→
More from coding & agent
- Terminal Night 3 talk slides released, missing demo video to follow — 4310sy · 2026-10-16
- Agent developers are sitting on unused API credits that can exceed actual usage — EnvironmentalDay8864 · 2026-10-16
- Notion's bet on agents: abstract away deployment so users and agents just write code — simonguozirui · 2026-10-16
- Four Gemini 4 Argon agents beat Minecraft's Ender Dragon autonomously in 27 hours — Maxence Faldor · 2026-10-16
- Tencent's Terminal-RSI builds recursively self-improving terminal agents, hitting 19.84% on Terminal-Bench 4.0 — tencent · 2026-10-16
- Tsinghua's AutoSFT uses multi-agent collaboration to automate SFT data research — TsinghuaNLP · 2026-10-16