Berth lets one RTX 4090 take turns between chat models, ComfyUI and a Windows VM
Distinct-Pie2389 · reddit · 2026-10-23
With a single 24GB RTX 4090 shared by chat models, a Strata engine, ComfyUI and a Windows gaming guest, the author built Berth (v0.3.4, open source): it leases the GPU to one holder at a time, drains VRAM at the end of each request, and hands the card on — even passing it to the Windows VM and back through the same lease mechanism.
Related event: Berth Lets a Single GPU Serve LLMs, ComfyUI and Windows VMs on Demand(2 posts)→
More from Infra
- OpenJet claims Qwen3.8-27B coding runs 1.9x faster than llama.cpp on one RTX 3090 — JeremyCMorgan · 2026-10-23
- Jensen Huang lays out NVIDIA's full Vera Rubin agentic system: NVL72, MGX, CMX and RTX — rohanpaul_ai · 2026-10-23
- ONNX to Transformers.js: running models directly in your browser — JosephJacks_ · 2026-10-23
- MiniMax M3.1 Flash free for 3 days on 0G, with 1M context and 512K output — MiniMax_AI · 2026-10-23
- "We bet on Cloudflare and it paid off": R2 and D1 at billion scale — dinasaur_404 · 2026-10-23
- Public data is drying up; private training data is turning into a browsable catalog — SucceededMind · 2026-10-23