Same analytics agent task: Sonnet 5.5 costs ~12x more than Haiku 5.5
sh_reya · x · 2026-11-16
A developer ran the same TPC-H analytics question through two models in a SQL agent: Haiku 5.5 vs Sonnet 5.5 produced the same answer, but Sonnet used 10% fewer prompt tokens and half the output tokens while costing 12x more ($0.0123 vs $0.0010). A/B comparison screenshots show the full token/cost breakdown — a stark reminder that model choice dominates cost in analytics agent workflows.
More from coding & agent
- Jiff 1.0 released: Rust datetime library already powering uv, Cargo and more — charliermarsh · 2026-11-16
- Agent notices Mac battery at 3% and pauses work to warn user — adonis_singh · 2026-11-16
- Plenio 2.0: open-source ComfyUI suite generates party songs locally in 185 seconds — Vivid_Promise1700 · 2026-11-16
- Three classes of programming languages in the AI era: natural language, performant code, and specs — dbreunig · 2026-11-16
- Turning newsletter edits into AI checks lifts frontier models 25+ points on summaries — danshipper · 2026-11-16
- WEKA open-sources kvlab: replay real agent traffic to benchmark KV cache offload — AccBalanced · 2026-11-16