Going multi-LLM: Sonnet 3.7 for hard tasks, DeepSeek for the rest, which gateway stack?
Extension_Lake4065 · reddit · 2026-10-28
A developer describes their team's shift from a single LLM provider to a multi-provider setup — Sonnet 3.7 for complex work, DeepSeek for everything else — with rocky adoption. They sort candidate tools into three categories and ask for recommendations:
- Self-hosted / open-source gateways: LiteLLM for centralized key management and failover routing;
- Unified workspace layers: Ramp Glass for team-wide SSO access to multiple LLMs plus spend tracking;
- Multi-agent orchestration frameworks: LangGraph for multi-model state machines and execution tracing.
The post doubles as a useful taxonomy of the multi-LLM tooling landscape.
More from coding & agent
- 10 open-source GitHub repos that hand your AI agents ready-made prompts, skills and automations — victor_explore · 2026-10-28
- Cognition CRO Silas Alberti to guest lecture at Stanford as firm's valuation soars to $48B — silasalberti · 2026-10-28
- Small business owner asks: what metrics actually matter for support AI agents? — Firm-Media-6253 · 2026-10-28
- ZCode offers 300M free GLM-5.3-Flash tokens daily, with a quirky claiming window — AccBalanced · 2026-10-28
- Building Agents That Get Cheaper and Better Every Run: Feedback Loop Design — LostLeek1304 · 2026-10-28
- Agents completing every step can still hurt outcomes — how to evaluate them? — djgoel123 · 2026-10-28