sleepy-llm: A Reverse Proxy That Auto-Wakes and Shuts Down Your Local LLM Server
ac101m · reddit · 2026-10-16
Reddit user ac101m released sleepy-llm, a reverse proxy that sits between clients and a local inference box: it wakes the machine on incoming requests and shuts it down after idle time to save power. It caches the /v1/models endpoint so OpenWebUI-style polling won't keep waking the server, and can check for logged-in users before shutdown. Nearly all the code was vibe-coded with local models and it has proven reliable in use.
More from coding & agent
- 14 open-source LLM observability tools to know in 2026, from Langfuse to Laminar — TheTuringPost · 2026-10-16
- Reddit debate: What are autonomous AI agents actually doing in production today? — hangman_111111 · 2026-10-16
- Kernel-Level Agent Sandboxing With macOS Seatbelt, No Docker Needed — mostly_deterministic · 2026-10-16
- Moving agent work from GPUs to CPUs for durable, predictable actions — cramforce · 2026-10-16
- Jev tutorial: 106x cheaper, 180ms yes/no gates replace PASS/FAIL string matching — max_paperclips · 2026-10-16
- Stop giving agents raw API keys: prepaid balances and per-credential caps — Cold_Hall_5384 · 2026-10-16