Self-hosted control panel runs llama.cpp, SD.cpp and audio.cpp from one browser tab
W61k3r · reddit · 2026-09-24
A developer open-sourced a self-hosted control panel for local AI: run llama.cpp chat models, stable-diffusion.cpp images and audio.cpp speech/music/sound from a single browser tab. Features include instances per GPU, 200+ explained settings, launch previews, VRAM/RAM estimates, benchmarks, power caps and a CLI. Self-described AI-assisted, built for personal use.
More from Infra
- Modal Labs in Talks to Raise at $15 Billion Valuation as Inference Rush Heats Up — nmasc_ · 2026-09-24
- Google paper: 55-70% of quantized LLM cold-start latency is just model loading — rohanpaul_ai · 2026-09-24
- Optical computing for AI debated as veteran cites lack of European interest — IgorCarron · 2026-09-24
- glance-vlm speedlab goes open source: MLX 8-bit cuts local camera VLM latency 27.6% — natesiggard · 2026-09-24
- ClusterMAX 3.0 debuts: comprehensive review of 77 neocloud providers, market view now spans 323 — demian_ai · 2026-09-24
- zlaya: a Zig-based CPU-only inference engine runs Laya on CDN edge via WebAssembly — jedisct1 · 2026-09-24