Berth: open-source VRAM leasing daemon stops OOM crashes when multiple AI engines share one GPU
Distinct-Pie2389 · reddit · 2026-10-12
Redditor Distinct-Pie2389 open-sourced Berth, a VRAM leasing daemon that stops CUDA out-of-memory crashes when running multiple engines (llama-swap, llama.cpp, Ollama, ComfyUI) on one RTX 4090. Engines start via berth run and queue with the daemon; when a higher-priority engine needs the GPU, Berth unloads the current holder (llama-swap unload URL, then SIGTERM, then SIGKILL) and only hands over once nvidia-smi confirms memory is free. Limits: Linux + NVIDIA only, one card per daemon, no dashboard auth (keep it on loopback/Tailscale). vLLM/SGLang/LM Studio/TabbyAPI/LocalAI support tested against docs only.
More from coding & agent
- David Fowler: build CLIs for agents to explore systems and fix bugs autonomously — mariorod1 · 2026-10-12
- rtoml v0.14 Adds Python 3.15 Support, i128 Ints, and Big Speedups — samuelcolvin · 2026-10-12
- Reverse-engineering ChatGPT's Intelligent UI: DIL language, server-side compilation and sandboxed runtime — rohanpaul_ai · 2026-10-12
- Reverse engineering leaks three unannounced Grok Bot features, versioned memory leading — bfrench · 2026-10-12
- badlogic demos durable codemode: persisting agent state so long tasks survive aborts — max_paperclips · 2026-10-12
- supermemory packages agent context into one API with memory, retrieval built in — julianweisser · 2026-10-12