vLLM deployment of Qwen 3.8 27B suffers from endless reasoning loops
germangrower69 · reddit · 2026-08-16
A developer reports severe latency issues deploying Qwen 3.8 27B via vLLM on an RTX 6000 Pro. Despite setting 'thinking effort' to low, medium, or xhigh, the model enters excessively long reasoning phases (1-5 mins), whereas Qwen 3.6 and DeepSeek V4 Flash respond in 20-30 seconds on the same hardware. Extensive tweaking of quantization, flags, and recipes has failed to resolve the issue.
More from Infra
- First AA-AgentPerf results: NVIDIA Vera Rubin NVL72 delivers up to 5.7x throughput per MW vs GB300 — ArtificialAnlys · 2026-10-16
- Vera Rubin NVL72 first benchmarks: up to 5.7x throughput per MW vs GB300 — ArtificialAnlys · 2026-10-16
- NVIDIA Vera Rubin NVL72 hits up to 5.7x GB300 throughput per MW on agent benchmark — ArtificialAnlys · 2026-10-16
- 14 open-source LLM observability tools to know in 2026, from Langfuse to Laminar — TheTuringPost · 2026-10-16
- Local AI is a routing problem, not a privacy feature: where each task should run — bigdata · 2026-10-16
- Moving agent work from GPUs to CPUs for durable, predictable actions — cramforce · 2026-10-16