llama.cpp New Command: One-Line Serve with MTP Speculative Decoding
ggerganov · x · 2026-08-15
ggerganov demonstrates the llama serve command in llama.cpp, enabling MTP speculative decoding with --spec-type draft-mtp, plus advanced options like --reasoning-preserve and --agent, simplifying local deployment.
Related event: llama.cpp Adds One-Command MTP Speculative Decoding(2 posts)→
More from coding & agent
- A vector DB is not LLM memory: long thread maps write/read paths, failure modes and evals — techNmak · 2026-10-16
- OpenUI 1.0 launches open source, turning agent text answers into live interactive UIs — heyshrutimishra · 2026-10-16
- 10 GitHub repos to see what your AI agent really did, from Langfuse to claude-code-log — victor_explore · 2026-10-16
- Mosaic: multi-session agentic RL with hierarchical advantage estimation — LARK-Lab · 2026-10-16
- Recursive Environment Scaling tanks six models' success rates by 57–77 points — Lingxiao Jing · 2026-10-16
- Harvard's MPT: decentralized agent swarms learn self-orchestration via bidding — Harvard · 2026-10-16