Agent developer seeks failover patterns after single-provider outage killed every run
Arkupathak · reddit · 2026-09-27
A developer describes how a single-provider setup caused every agent run to fail when that provider degraded, and is now designing automatic fallback: if model A errors or times out, retry on an equivalent model elsewhere. He asks three open questions: fall back to the same model on another host or a different model (prompts don't always carry over); build it yourself or use a gateway (LiteLLM, Portkey, llmapi.ai all advertise fallbacks); and how to keep fallbacks from quietly running up costs by landing on pricier models.
More from coding & agent
- Science Mode Auto-Edits Explainer Videos with Claude, Scripts and Your Footage — realmeetjames · 2026-09-27
- MIT Textbook Chapter on Paper Writing Goes Viral: Only Good Papers Count — Haoyu_Xiong_ · 2026-09-27
- pdfcn: styled PDF Claude Code skill shipped as a shadcn component library, 2.2k stars — rchardkovacs · 2026-09-27
- Building a "natural language autoencoder" to chat with your garden — cephaloform · 2026-09-27
- Open-source git-story-film Skill Turns Your Git History Into a Short Film — dotey · 2026-09-27
- Rust-style constrained languages suit LLMs; agent-targeted DSLs are coming — burny_tech · 2026-09-27