Quail: open-source AI-SQL engine hits 1B+ input tokens/min on a single H100
sh_reya · x · 2026-09-26
- shreya and Modal released Quail, a new open-source AI-SQL engine.
- Key idea: jointly plan queries and LLM inference instead of treating them separately.
- Result: a single query sustains 1B+ input tokens/min on one H100.
- The authors argue AI-powered data operators create a novel inference workload class with implications for infra design.
Related event: Open-source AI-SQL engine Quail hits 1B+ tokens/min on a single H100(21 posts)→
More from Infra
- steipete pushes back on agent cost concerns: capable models now $0.1 per million tokens — steipete · 2026-09-26
- e/acc leader shows off e/acc-wrapped home inference cluster, dubs it the new status symbol — beffjezos · 2026-09-26
- Ling Tiny 3.0 on a 2017 laptop: 8B model hits 10 tok/s, hints at edge AI future — netherreddit · 2026-09-26
- US AI buildout projected at $10.3 trillion over 6 years, bigger than rail, highways, electrification and telecom combined — 141_1337 · 2026-09-26
- Oh My Pi adds custom model backends: vLLM, llama.cpp, SGLang and more — bolts98 · 2026-09-26
- OpenRouter launches typesafe/jev-router, a cache-aware router that picks models per request — alexcovo_eth · 2026-09-26