llmux manages vLLM and llama.cpp model swaps with one profile per model
Available-Message509 · reddit · 2026-07-27
The author built llmux to reduce the friction of swapping models across vLLM and llama.cpp.
- Each model is defined as a profile once, then launched from a menu on the engine it belongs to.
- The same engine at different versions can also be pinned as separate profiles, such as release, nightly, or a custom build.
- It includes a headless CLI for scripting and remote use: llmux up, ps --json, logs, and bench.
- Current requirements: Linux, an NVIDIA GPU, and Docker with NVIDIA Container Toolkit; macOS and AMD/ROCm are not supported yet.
- The project is open source under MIT and the author says they use it in real team work.
More from coding & agent
- AI agents need memory to become real systems, says new roundup — eyishazyer · 2026-07-27
- Applied AI is moving from chatbots to event-driven distributed systems — remilouf · 2026-07-27
- Multi-Head Latent Control uses hidden states to cut large-model calls by up to 90.7% — HuaweiTech · 2026-07-27
- Windows DB-driven app builder asks what one AI subscription can really cover — Proud-Ticket-9379 · 2026-07-27
- Procedural and retrieval memory are becoming core agent primitives — goyalshaliniuk · 2026-07-27
- Graph memory and vector memory power modern AI retrieval stacks — goyalshaliniuk · 2026-07-27