Low-power router with Wake-on-LAN to manage idle AI servers efficiently
Ok-Breakfast1878 · reddit · 2026-08-24
To manage the high idle power draw (150W+) of dual AI servers, a user proposed a low-power (15W) mini-PC acting as an OpenAI-compatible API router. This router would hold incoming requests, wake the specific server via Wake-on-Lan, and proxy the traffic transparently. It would also handle suspension logic based on time of day and inactivity to minimize energy waste. The author is seeking existing tools or feedback on this architecture.
More from Infra
- engy.ai processes 50B+ tokens in a day as open-model inference demand surges — const_reborn · 2026-10-16
- New inference engine 'e' hits 10,500 tok/s on a single DGX Station — brandon_galang · 2026-10-16
- SGLang ships Day-0 support for FLUX 3 Image Klein: 10 reference images, BF16/FP8/NVFP4 variants — ying11231 · 2026-10-16
- NVIDIA's Nemotron 3.5 Super VL hits CoreWeave: 12B-active multimodal MoE at $0.25/M input tokens — wandb · 2026-10-16
- Chip equipment beats bull case: 2026 WFE seen at $153B, $278B by 2030 — BenBajarin · 2026-10-16
- Steam now launches in 5.23s, beating Epic's 5.47s — and vLLM gets roasted for slow startup — AlpinDale · 2026-10-16