LiteLLM Brownout: open-source plugin shifts routes to cheaper models as team budgets fill up
Creepy_Wave_6767 · reddit · 2026-10-22
- A new open-source plugin, LiteLLM Brownout, fixes a LiteLLM gateway pain point: when a team exhausts its weekly budget, LiteLLM refuses all requests and Claude Code/Codex die mid-task.
- Like a power grid browning out, it slides chosen routes to cheaper models as spend climbs (configurable thresholds), while routes without fallbacks (e.g., code review) keep their primary model.
- Unlike LiteLLM's built-in budgets (alerts at 85%/95%, per-key per-model fallbacks), Brownout acts on team totals, validates each fallback's pricing and key availability, and writes all config via one command. Supports Docker Compose, Kubernetes, or pip.
More from coding & agent
- Google and Meta bring native TPU training to TorchTitan, supporting Llama 3 and Qwen 3 pretraining — rseroter · 2026-10-22
- Tsinghua's Design Anything uses intent-execution graphs to keep design agents on-brief at scale — Xuchao Ren · 2026-10-22
- Open source is dead in the coding-agent era: power shifts from skill to capital — MarcJSchmidt · 2026-10-22
- Manim-style presentation template built with Claude and Codex, now open-sourced — mmbronstein · 2026-10-22
- Dev builds Mac browser with MCP server so Claude Code can browse with real logins — DhammaIY · 2026-10-22
- Maggie Appleton's new talk: better boundary objects and thicker interfaces for planning with agents — IanArawjo · 2026-10-22