ComfyUI update doubles Qwen LLM token rates on consumer GPUs, up to +251% on RTX 5090
Lexius2129 · reddit · 2026-11-12
The ComfyUI team shipped optimizations that dramatically speed up local text generation with Qwen models — most local users still run 12GB RTX 3060 cards, so the team keeps optimizing for consumer hardware.
Benchmark data from the official blog (v0.40.0 vs v0.44, Qwen 3.x W4A8):
- RTX 5090: Qwen3.5 9B story generation 106 → 219 tokens/s (+106%); Qwen3.8 27B story +91%, image captioning +120%, and 12k-context runs 40 → 142 tokens/s (+251%).
- RTX 5080: gains of 41–136%.
Text generation matters in creative workflows for prompt building and local harnesses like Comfy Agent.
Related event: ComfyUI Boosts Local Qwen Text Generation by Up to 251%(2 posts)→
More from Infra
- Bloomberg: Nvidia leadership crisis may push AI customers to Google TPUs, $50B sales by 2027 — dinabass · 2026-11-12
- PyTorch recaps Ascend Beijing meetup: Chinese open-weight models hit 45% of OpenRouter traffic — PyTorch · 2026-11-12
- Hash Rate Ep. 191: TPN Subnet 65 on LLM Quantization-as-a-Service — markjeffrey · 2026-11-12
- What we learned building an AI token usage dashboard that actually helps — rseroter · 2026-11-12
- Cloudflare cuts Durable Objects cold starts and improves relocation routing, no code changes needed — irvinebroque · 2026-11-12
- Nvidia anchors Anthropic IPO, backs OpenAI, CoreWeave and Stargate — risk is systemic — deliprao · 2026-11-12