Berth: a lightweight open-source GPU resource manager with multi-GPU scheduling and VRAM parking

Distinct-Pie2389 · reddit · 2026-11-19

A developer announced berth, a lightweight GPU resource manager built to stop local LLMs, image generation, and voice cloning from fighting over VRAM.

Features include parking engines in system RAM, parking via CUDA checkpoints, priority mapping, scheduling, lending part of a GPU's VRAM pool, and leasing whole GPUs via VFIO passthrough. Even with a single dedicated engine, berth keeps squatters (nodes, stale or orphaned processes) out of its VRAM. The author aims to solve VRAM issues at the driver level while staying lightweight and durable.

Original post →

More from Infra

Infra channel →