ARBR open-sources an MIT-licensed routing and governance layer for multi-provider LLM traffic

Genie-Tickle-007 · reddit · 2026-09-03

ARBR is a self-hosted, MIT-licensed OpenAI-compatible endpoint that sits in front of your LLM providers, classifies each request by task type and difficulty, and enforces routing rules, budgets, and rate limits in the request path. Model swaps are validated via evals on sampled live traffic, then rolled out with shadow/canary deployment and automatic rollback on quality regression; all promotions require human approval. Launched on Product Hunt with the repo at project-arbr/arbr-control-plane.

Original post →

More from coding & agent

coding & agent channel →