Berth v0.6.0 leases one RTX 4090 across 23 engines, 143 lease-hours a week
Distinct-Pie2389 · reddit · 2026-11-16
Berth, an open-source VRAM lease manager, shipped v0.6.0 with around 300 users. New features: per-card native scheduling, uninterruptible training via berth train, and learned engine resource claims.
The author shares a month of stats from a single RTX 4090 workstation running llama-swap, NInfer, Strata, ComfyUI, coding agents and games: 1,136 requests waited for the card instead of stacking, 901 engines drained at job boundaries, 23.9 TiB of VRAM handed over, 573 lease-less VRAM holders reported, and 4 stalled releases caught before the card jammed. In the last 7 days, 23 engines held the card for 143 lease-hours.
Project: https://github.com/T-Crypt/berth
More from coding & agent
- Same analytics agent task: Sonnet 5.5 costs ~12x more than Haiku 5.5 — sh_reya · 2026-11-16
- Jiff 1.0 released: Rust datetime library already powering uv, Cargo and more — charliermarsh · 2026-11-16
- Agent notices Mac battery at 3% and pauses work to warn user — adonis_singh · 2026-11-16
- Three classes of programming languages in the AI era: natural language, performant code, and specs — dbreunig · 2026-11-16
- Turning newsletter edits into AI checks lifts frontier models 25+ points on summaries — danshipper · 2026-11-16
- WEKA open-sources kvlab: replay real agent traffic to benchmark KV cache offload — AccBalanced · 2026-11-16