CMU open-sources Quail, an AI-SQL engine that runs LLM prompts per SQL row

sh_reya · x · 2026-10-08

Full Stack Data Lab at CMU released Quail (QUery Aware Inference Layer), an open-source, MIT-licensed execution engine for AI-SQL and LLM-powered dataflows. AI-SQL extends SQL with operators that let you write natural-language logic evaluated by an LLM on every row, e.g. WHERE AI.IF(PROMPT('Does this review discuss the ending?')). Quail's query optimizer automatically decides whether to enable prefix sharing based on document overlap and the cost-benefit of KV writes. Available on PyPI as quail-engine; 149 stars so far.

Original post →

More from coding & agent

coding & agent channel →