vLLM day-0 support for looped Inkling: 2.68x faster decode on GB200 with 78% fewer kernels

vllm_project · x · 2026-11-21

vLLM shipped day-0 support for Thinking Machines' looped Inkling model (12 shared core layers, 3 passes, gated cross-pass messages) along with systems optimizations:

Related event: vLLM Adds Day-0 Support for Inkling Recurrence Model, Up to 2.68x Faster Decoding on GB200(2 posts)→

Original post →

More from Infra

Infra channel →