vLLM adds Thinking Machines' Inkling-2-Small with 1M context and 1100 tok/s
vLLM released a one-command deployment recipe for Thinking Machines' Inkling-2-Small, a 594B-parameter MoE with 17B active, 1M context, and 1100 tok/s on a single GPU, along with DSpark speculative decoding details.
2026-11-13 ~ 2026-11-13 · 2 related posts
- Episode 1: Thinking Machines Open-Sources Inkling 2 Small Weights Under Apache 2.0(2026-11-13, 12 posts)
- Episode 2: vLLM adds Thinking Machines' Inkling-2-Small with 1M context and 1100 tok/s(2026-11-13, 2 posts)
- Inkling 2 Small serving details: ~1,070 TPGS agentic throughput at 32K context — vllm_project · 2026-11-13
- vLLM ships recipe for Thinking Machines' Inkling-2-Small: 594B MoE, 1M context, ~1,100 tok/s/GPU — vllm_project · 2026-11-13