Seeking Help: Smart Routing for Multiple ComfyUI Instances
WdPckr-007 · reddit · 2026-08-22
A user has added two laptops with 8GB VRAM to a Kubernetes cluster running ComfyUI. Currently, requests are load-balanced via round-robin Ingress. The user seeks a way to implement "smart routing" that directs requests to the most suitable instance based on workflow content (e.g., model weights, repeat counts, workflow type) rather than random distribution. They are asking for existing open-source projects or advice on building a custom Python API to handle this.
More from Infra
- MCP Isn't Replacing APIs: It's Changing Who APIs Are Designed For — kush_patil · 2026-08-22
- Data Center Opposition Surged from 42 to 75 Percent in One Year — The Decoder · 2026-08-22
- Qwen3.8-27B gets DFlash2 speculative-decoding GGUF release for llama.cpp — incoai · 2026-08-22
- Woolly post-trains Qwen3-8B for 2–3× faster math & code decoding — bosmeny · 2026-08-22
- Opinion: States Banning Data Centers Face 20 Years of Economic Depression — GabGarrett · 2026-08-22
- Vercel Fixes TLS Fragmentation Issue, All Websites Back Online — uwukko · 2026-08-22