Berth: a Go binary that time-shares one GPU between AI engines and games via leases
Distinct-Pie2389 · reddit · 2026-10-20
A Reddit user shares how they run llama-swap, Ollama, ComfyUI, Strata and a game on a single GPU using Berth, a Go binary that leases the GPU to whichever engine asks. Engines launched via berth run take turns: when a new process needs VRAM, Berth drains the current holder, waits for the driver to report memory free, then grants the lease — and brings the previous engines back when the newcomer exits.
Key features:
- Never kills processes it didn't start; unleased VRAM holders show up as "stowaways" with PID and memory usage
- berth harbor: a web UI departures board with charts and 30 days of history
- berth gateway: one OpenAI-compatible port that starts the right engine per model name
- berth pull: downloads from Hugging Face with sha256 verification
- Per-card telemetry: memory, temperature, tokens/s, a token ledger and per-model leaderboard
Linux + NVIDIA today, Windows experimental. Alpha, Apache-2.0.
More from coding & agent
- REA gains 214K stars in a week, tops GitHub's fastest-growing AI repos — sven_ai · 2026-10-20
- Dev goes 'graph pilled': graphs will anchor every company's world model — _AustinCalvert_ · 2026-10-20
- RuneBench: Benchmarking AI Coding Agents by Playing RuneScape — charliermarsh · 2026-10-20
- A 5-step loop for debugging AI agents in production: trace everything, watch for silent failures — Tracify · 2026-10-20
- New Claude Cookbook: Auto-Review Agent Session Transcripts for Security Issues — brada · 2026-10-20
- Conversational Video Editing: Driving CapCut Web with Codex for Marketing Videos — Div_pradeep · 2026-10-20