Databricks Cuts Internal AI Costs by 90% via Smart Routing and OSS Models
Yuchenj_UW · x · 2026-08-08
Databricks published a detailed analysis of how they drastically reduced internal AI spend while aggressively growing adoption, achieving up to 90% cost reduction in some scenarios.
Key cost-saving strategies include:
- Shifting to efficient models: Switching defaults to more efficient OSS models like GLM. Maximum intelligence models aren't always needed for coding tasks; shifting traffic via gateways saved approx. 50%.
- Smart routing: Automating model selection to dynamically choose the most efficient model or harness for specific tasks, yielding around 30% further savings.
More from coding & agent
- DeepMind turns coding agent Antigravity into a science tool, surfacing novel antimicrobial peptide in one session — pushmeet · 2026-10-16
- Cross-review coding workflow: Claude writes the plan, Codex audits it — theteknosaur · 2026-10-16
- Simon Willison: code mode is the future of tool calling, if it can be sandboxed — springrod · 2026-10-16
- Normalizing Claude's schema-free MCP output before it hits downstream n8n nodes — snowingbol · 2026-10-16
- Agent named 'Ilya' reportedly scores 1.1pt higher on benchmarks — daniel_mac8 · 2026-10-16
- A plain notes.md fixed my agent's cross-session amnesia better than chat history — rahul_watertech · 2026-10-16