Open-source AI-SQL engine Quail hits 1B+ input tokens/min on a single H100
sh_reya · x · 2026-09-25
shreya's team, in collaboration with Modal, released Quail, an open-source AI-SQL engine that lets users write queries like SELECT FROM reviews WHERE AI.IF("the review discusses the ending").
The catch: AI operators are wildly expensive — an AI filter calls an LLM for every row, and an AI join for every candidate pair (mn), so one query can trigger millions of LLM calls.
By planning queries and LLM inference together, Quail reaches 1B+ input tokens/min on a single H100 for a single query — a new and interesting inference workload, the authors argue.
Related event: UC Berkeley and Modal Open-Source Quail, an AI-SQL Inference Engine(25 posts)→
More from coding & agent
- VentureTwins maps the B2A economy: dozens of agent infra and app companies in first series installment — venturetwins · 2026-11-12
- Spinning up containers for 20-line agent tools is backwards: Safescript compiles provable, 50ms-deploy apps — uriwa · 2026-11-12
- Stripe launches claimable sandboxes: frictionless payment integrations for AI agents — jeff_weinstein · 2026-11-12
- Databricks launches autonomous AI coworker Genie: 91% on enterprise tasks with half the tokens — Yuchenj_UW · 2026-11-12
- Reddit asks: how do you pick an LLM for your AI agent — cost, speed, or task fit? — jakingo · 2026-11-12
- Loom founder launches Roma 2.0, a shared to-do list that orchestrates AI agents — thetripathi58 · 2026-11-12