LMDeck: a macOS menu-bar app to unload local LLMs across backends in one click
Fickle_Tradition4491 · reddit · 2026-11-15
A solo developer released LMDeck, a macOS menu-bar app that lists every loaded local LLM with its memory and context length and lets you unload it in one click—solving the panic of running out of RAM with no idea which server holds the model.
- Zero setup: auto-discovers llama.cpp, oMLX, LM Studio, vLLM, text-generation-webui, SGLang, KoboldCpp, and llama-swap.
- Shows a red dot on the currently generating model by reading oMLX's scheduler activity.
- If a backend lacks an unload API (e.g., llama.cpp), it kills the server process.
Paid app with 14-day free trial, requires macOS 15+ on Apple Silicon; accepted feature requests earn a free license.
More from Infra
- srush's blog verifies floating-point certificates for 152 ML operators, finds unreported bugs — ChrSzegedy · 2026-11-15
- AGI would still face a world running on decades-old infrastructure no one dares to touch — SuB8u · 2026-11-15
- SpaceX cuts AI datacenter build time to ~4 months, MiniHard done in 5 — Dr_Singularity · 2026-11-15
- 33B MiniMax-H3-Image image model runs fully on a Snapdragon phone NPU, no cloud — shirosoro · 2026-11-15
- Kosmo and Ropedia release Physical AI dataset: 1,589 3D-scanned environments, 131 hours of egocentric video — liuziwei7 · 2026-11-15
- Retired Microsoft engineer explains what broke in the Outlook outage — nicolascraske · 2026-11-15