14B open model on one RTX 4090 matches hosted frontier model on text-to-SQL; mnemiq open-sourced

ycombinator · x · 2026-09-09

After running 28 configurations, grading 25,000+ answers, and benchmarking against Snowflake and Databricks, the team found a 14B open model on a single RTX 4090 matched their hosted frontier model on text-to-SQL. Their takeaway: model size, vendor reputation, and published benchmark scores are poor predictors of performance on your own database. They've open-sourced mnemiq so you can test on your own data.

Original post →

More from coding & agent

coding & agent channel →