Unswarm: Self-Hosted Runtime Manager and Proxy for Multi-Model LLM Setups
Atretador · reddit · 2026-08-23
Unswarm is a self-hosted runtime manager and proxy designed to simplify managing multiple local LLM containers and scripts. It allows users to register specific containers or bash scripts, define concurrency rules, and automatically queue requests.
Key Features:
- Unified Proxy: Provides a single API endpoint for all registered models, proxying requests to the correct backend.
- Smart Scheduling: Automatically starts runtimes if they are not active and streams responses; manages concurrency based on user-defined rules.
- Multi-Agent Orchestration: Supports setups with a persistent orchestrator (e.g., Qwen 27B) and switching sub-agents (e.g., Qwen 9B/35B) for specific tasks.
- Remote Access: Can be hosted on a VPS to access local models remotely or distribute agents across different machines.
Note: Switching models inevitably resets the cache, making it suboptimal for mid-session model switching.
More from coding & agent
- Fixes Keep MCP server reauthentication loop on refresh token expiry — iannuttall · 2026-08-23
- Dev实测 Sol 完胜 Deepseek Pro，解决 Twitter 开发难题 — oran_ge · 2026-08-23
- AgentMail: Give your Grok Bot its own email address — PrajwalTomar_ · 2026-08-23
- Master prompt builds a full pay-to-rank app: schema, Stripe, RLS included — aliscodes · 2026-08-23
- Pay-to-rank leaderboard made $100k in 2 days — full build recipe shared — aliscodes · 2026-08-23
- Devs discuss collab on fast-iterating frontend models and Cursor plugin — aidenybai · 2026-08-23