vLLM Cuts Flint Kernel Launches from 22 to 7 per Layer with Recursive SI

vllm_project · x · 2026-10-22

vLLM partnered with Recursive SI to make Flint fast from day one: custom kernels and aggressive fusion cut kernel launches from 22 to just 7 per layer. Architecture, optimizations, and a getting-started guide are now published.

Related event: Recursive releases Flint, an open-weights 40B MoE coding model built in under 4 months by its automated Eureka research system(50 posts)→

Original post →

More from Infra

• SPCX earnings call highlights 'computer per watt' metric as AI value shifts down the stack — mobileraj · 2026-10-22
• Eureka Machine runs on Mac inference so quietly the author's MacBook barely spins its fans — cong_ml · 2026-10-22
• Compute demand is so hot it's becoming a month-to-month auction, analysts say long-term contracts are dying — BenBajarin · 2026-10-22
• SGLang ran early RL training on TPUs with Miles and TorchTitan, with promising results — ying11231 · 2026-10-22
• CXMT's market cap tops all mid-size Asian fabs combined, half of SK Hynix — pstAsiatech · 2026-10-22
• SemiAnalysis: DeepSeek's open-sourced DeepInfer lacks key inference-serving components — cHHillee · 2026-10-22

Infra channel →