MotherDuck makes text classification 50x faster at ~1% of LLM cost
josh_wills · x · 2026-09-22
MotherDuck launched promptjev(), a SQL function powered by TypeSafe's new Jev model. Classifying 100k rows now takes 40 seconds and $0.50 at frontier-LLM accuracy, versus 32 minutes and $37 with an LLM — 50x faster at 1% of the cost. Engineers are calling it their favorite use case yet: intelligence cheap enough to apply to every row.
More from Infra
- Same GPU, Four Ways to Buy It: What Nebius Spot Pricing Reveals About Compute Economics — demian_ai · 2026-09-22
- Tata Elxsi's IRIS: edge filtering cuts cloud frames 70-80% for real-time factory safety AI — AWS ML Blog · 2026-09-22
- bitsandbytes2 slightly delayed: zero-config lazy compression plus dynamic expert swaps for near-infinite KV cache — Tim_Dettmers · 2026-09-22
- Iterative sensitivity probing: how bitsandbytes2 finds each layer's compression limit — Tim_Dettmers · 2026-09-22
- Tim Dettmers releases runtime dynamic compression framework, hits 1.5-2.0 bit at high quality — Tim_Dettmers · 2026-09-22
- PSA: Non-US Users Should Consider Local AI in Case Governments Ban LLMs — TheMoonMidas · 2026-09-22