Quail: open-source AI-SQL engine hits 1B+ tokens/min on one H100
sh_reya · x · 2026-09-25
shreya unveiled Quail, a new open-source AI-SQL engine built with Modal. By planning queries and LLM inference together, it reaches 1B+ input tokens/min on a single H100 for a single query. The authors argue AI-powered data operators create a novel inference workload worth attention from infra folks.
More from Infra
- Liquid AI Ships DSpark Draft Model, Speeding Up LFM2.5-VL-3B Decoding Up to 3.13x — JosephJacks_ · 2026-09-25
- DIY Local LLM Cluster: Quad RTX 5070 Ti + Quad 5060 Ti Nodes With vLLM FP8 Inference — Whahine · 2026-09-25
- AMD and Perplexity Partner to Build an 'Agentic PC' on Ryzen AI Halo — AravSrinivas · 2026-09-25
- Water, Noise, Power: What Data Center Critics Get Wrong About Real Costs — bigdata · 2026-09-25
- Powering a home GPU cluster: one PDU safely feeds ~16 RTX 6000 Max-Q cards — TheZachMueller · 2026-09-25
- Docker launches Cloud Sandboxes: microVM isolation for always-on agents, $250 credit — juntao · 2026-09-25