Quail open-source inference engine adds GDN hybrid architecture support, 3.2x faster than vLLM

CMU Full Stack Data Lab's open-source SQL inference engine Quail now supports hybrid-architecture models such as Qwen3.5 with Gated DeltaNet layers. By caching recurrent states, it achieves over 3x speedup compared to vLLM.

2026-11-17 ~ 2026-11-17 · 2 related posts