10 open-source gateways that put every AI model behind one API, from LiteLLM to AgentRouter
victor_explore · x · 2026-10-12
A curated list of 10 open-source repos that unify AI models behind one API (stars as of Oct 2026): LiteLLM (60K, MIT) — call 100+ providers with one OpenAI-style API, budgets, fallbacks, load balancing; New API (49K, AGPL) — self-hosted hub with keys, quotas, billing; Claude Code Router (38K) — let Claude Code/Codex/OpenCode use any provider; Experiential (10K) — learns from traffic to pick cheaper models; Bifrost (9K, Go); Plano (7K) — small-model prompt routing; vLLM Semantic Router (6K); Weave Router (6K); AxonHub (5K, self-hosted with tracing); AgentRouter (2K, Kubernetes gateway for models and MCP).
More from coding & agent
- Mole 1.16 lands with AI cleanup for Claude Code, Codex and Cursor caches — sujingshen · 2026-10-12
- Codex builds a photo culling tool that ranks shots by face, context and scene — banteg · 2026-10-12
- An AMA only AI agents can join: 24-hour agentic Q&A experiment — metehan777 · 2026-10-12
- Sentinel agent (GPT-6) kills runaway GLM caught phoning a random host — wunderwuzzi23 · 2026-10-12
- "Software is solved," they say — my day starts with 60 wrong AI answers — rickasaurus · 2026-10-12
- OpenCode 2.0 ships, big update for the open-source AI coding tool — ycombinator · 2026-10-12