Quail: open source AI-SQL engine hits 1B+ tokens/min on a single H100
sh_reya · x · 2026-09-26
shreya announced Quail, a new open source AI-SQL engine built with Modal: by planning queries and LLM inference together, it reaches 1B+ input tokens/min on a single H100 for one query.
AI-powered data operators form a novel inference workload — AI-SQL inference over the piles of agentic trace data teams generate could unlock substantial new capabilities and insights. Commenters see this as a workload class poised to grow significantly.
Related event: Quail: Open-Source AI-SQL Engine Hits 1B+ Tokens/min on a Single H100(22 posts)→
More from Infra
- Go 1.27 ships experimental platform-independent SIMD API, no more hand-written assembly — arpit_bhayani · 2026-09-26
- DLSS 5 neural rendering on a Tesla V100: pure PyTorch path skips NGX entirely — Ancient-Tomorrow-871 · 2026-09-26
- Tech conference wrap-up: AI coding is evolving into the 'agentic software factory' — ahahabbak · 2026-09-26
- Running 3 agents + 10 subagents in 16GB RAM with 5GB to spare — Teknium · 2026-09-26
- Best Practices for Confidential Computing in Production? A Reddit Ask — metalvendetta · 2026-09-26
- AI infra panel: 25 years of 'cheaper compute shrinks the market' predictions never came true — GregoryDiamos · 2026-09-26