vLLM ships Day-0 support for TML model, cuts GB200 decode latency to 3.84ms

vllm_project · x · 2026-11-21

vLLM announced Day-0 support for TML's Looped Inkling model: TML provided the model and reference implementation, while @inferact and the vLLM community handled serving integration.

Original post →

More from Infra

Infra channel →