Berth: Go-based GPU lease manager hot-swaps llama.cpp, ComfyUI and games on one card
Distinct-Pie2389 · reddit · 2026-11-02
A developer released Berth (alpha v0.4.1), a lightweight GPU resource manager written in Go — a single binary with no cloud dependency, supporting Linux NVIDIA plus experimental AMD/Windows — that arbitrates GPU access via leases, priorities, and a request queue instead of letting apps fight over VRAM.
Highlights:
- Sharing & scheduling: local LLMs, image generation, voice engines, and games share one card; requests queue by priority and handoffs wait for the current task to finish and release memory.
- Fast switching: parks engines in system RAM or uses CUDA checkpointing to avoid reloading large models from disk.
- Monitoring & model management: tracks VRAM/temperature/power/processes; discovers models across GGUF, Hugging Face, LM Studio, and Ollama directories.
- Unified gateway: OpenAI-compatible API to start/switch engines plus ComfyUI workflow support, with a web dashboard for live leases and telemetry.
- Agent integration: installable skills for Claude Code, Codex, OpenCode and others; VFIO VM passthrough and independent multi-GPU management.
Diagrams show the handoff flow — gateway queues requests, the current engine drains at task boundaries, the grant waits until the driver reports free memory — and an evening of llama-swap, a game, a VM, and ComfyUI taking turns on one 24GB card.
More from coding & agent
- 7-Year Animator Says Claude One-Shot an Animation That Would Take Him Days — Error4010 · 2026-11-02
- Opus 5.5 recreates OpenAI's promo films entirely in code with three.js and GLSL — OfirPress · 2026-11-02
- Dev builds self-described computer use system: 3x faster than Vercel, beats Claude — RileyRalmuto · 2026-11-02
- VisMatch v1.4.0 adds RaCo, UPAL, REDI-Match: test 50+ image matchers in 5 lines — gabriberton · 2026-11-02
- CEPO Splits Coordination from Execution, Boosting Multi-Agent Prompt Optimization Across 11 Benchmarks — Jongha Kim · 2026-11-02
- Running Claude in an endless autonomous loop, it only shows what it thinks is cool — jaivin · 2026-11-02