Omnigent Ships LLM Cost Controls: Smart Routing Plus Progressive Budgets to Stop Runaway Bills
TerryTangYuan · x · 2026-09-04
Omnigent, led by Yuan Tang, has released production-ready LLM cost controls targeting runaway bills from long debugging sessions or multi-agent workflows.
- Prevention: a trivialgate policy uses a lightweight LLM to classify messages as TRIVIAL or COMPLEX, blocking trivial requests (lookups, greetings, one-line edits) from reaching expensive models like Opus, Fable, and GPT-5
- Control: progressive budgets warn before they block, then downgrade work to Sonnet/Haiku instead of hard-stopping mid-task
- Visibility: a /usage page breaks down spend by harness, model, and session
- Safeguards: thrashing detection, scheduled-task limits, and terminal approvals
Rollout is phased: visibility first, then routing, then budgets. Docs include YAML policy examples and custom pricing for self-hosted models.
More from coding & agent
- Apollo ships Watcher Live, a real-time coding-agent monitor that blocks dangerous actions — MariusHobbhahn · 2026-09-04
- Consultant recounts week training Harvard's Opportunity Insights on agentic coding with Codex — aniketapanjwani · 2026-09-04
- Chinese Researcher's "End of Software Engineering" Paper: Agents Score 80% Isolated, 38% Long-Term — alex_verem · 2026-09-04
- Reading code in the AI era: one dev reads all day to steer coding agents, misses provider outage — JFPuget · 2026-09-04
- DIY AI companion built on SQL + Qdrant remembers 1,608 conversation episodes — RoadsterAlex · 2026-09-04
- Why cloud-based AI agents fit long-running development tasks, per OpenRouter — thisiskp_ · 2026-09-04