Low-power router with Wake-on-LAN to manage idle AI servers efficiently
Ok-Breakfast1878 · reddit · 2026-08-24
To manage the high idle power draw (150W+) of dual AI servers, a user proposed a low-power (15W) mini-PC acting as an OpenAI-compatible API router. This router would hold incoming requests, wake the specific server via Wake-on-Lan, and proxy the traffic transparently. It would also handle suspension logic based on time of day and inactivity to minimize energy waste. The author is seeking existing tools or feedback on this architecture.
More from Infra
- Stanford's Marin 535B Model Training Starts with Full Transparency — udmrzn · 2026-08-24
- Seeking Real-World Benchmarks: R9 7900XTX Running Qwen2.5-72B — BillyQ · 2026-08-24
- Splitting GPUs Across VMs Boosted Ollama Performance by ~3x — NicolaZanarini533 · 2026-08-24
- Gated DeltaNet-2 gets full cuDNN support, ~3x faster end-to-end training on NVIDIA GPUs — ZGojcic · 2026-08-24
- M5 Max vs RTX 5080/5090 for local visual AI workloads — durumertt · 2026-08-24
- Hippius launches decentralized storage at 1/100th of Big Cloud costs — markjeffrey · 2026-08-24