Quail: open-source AI-SQL engine hits 1B+ tokens/min on a single H100
sh_reya · x · 2026-09-25
shreya and Modal released Quail, an open-source AI-SQL engine built by co-designing query planning with LLM inference. AI-powered data operators form a novel inference workload, and by planning queries and inference together Quail reaches over 1 billion input tokens per minute on a single H100 for a single query — a showcase of how far inference-stack/use-case co-design can push throughput.
Related event: UC Berkeley and Modal Open-Source Quail, an AI-SQL Inference Engine(25 posts)→
More from coding & agent
- Pigment Agents now reads and posts in Slack, inheriting user permissions — mattturck · 2026-11-12
- Map of the agent economy: 50+ startups across payments, spend control, identity, memory — venturetwins · 2026-11-12
- OpenCode launches Browse, an on-device browser agent with local logins — Saul_Loveman · 2026-11-12
- VentureTwins maps the B2A economy: dozens of agent infra and app companies in first series installment — venturetwins · 2026-11-12
- Google releases 76-page 'Agents Companion' whitepaper on agent engineering — mdancho84 · 2026-11-12
- Spinning up containers for 20-line agent tools is backwards: Safescript compiles provable, 50ms-deploy apps — uriwa · 2026-11-12