Self-hosted proxy unifies 424 AI models behind one OpenAI-compatible endpoint
ranadheer535 · reddit · 2026-07-27
A Reddit user found a self-hosted proxy called puter-api-proxy that exposes 424 AI models through one OpenAI-compatible endpoint.
- It advertises access to models such as Claude Opus 5, GPT-5.6, Gemini 3.5, Grok 4.5, DeepSeek V4, and Qwen3.
- The proxy supports automatic fallback: if one model fails, the system instantly tries the next one.
- It claims compatibility with tools like Claude Code, Cursor, Aider, and Cline, plus any OpenAI client.
- Deployment is presented as a one-command Docker setup, and the project includes an analytics dashboard.
- The most notable hook is the combination of broad model aggregation and a free tier for 15 models.
More from Infra
- Triton backend pushes Falcon3-10B to 97.5 tok/s on an RTX 5070 — OCV_Researcher · 2026-07-27
- Sparrow switches its Standard mode to Ministral 3 14B for local document extraction — andrejusb · 2026-07-27
- Nvidia supplier Wistron opens $700 million Texas plant for GB300 and Vera Rubin systems — Beth_Kindig · 2026-07-27
- BeeLlama.cpp v0.4.1 adds KV-cache precision tails and new quantization modes — Anbeeld · 2026-07-27
- Running 100 million tokens through GLM 5.2 NVFP4 locally costs about $1 — _akhaliq · 2026-07-27
- Cloudflare’s AI-training block can also stop Googlebot after September 15 — daluoseo · 2026-07-27