Qwen 3.6 27b Local Loading Anomalously Biases CPU
Br0lynator · reddit · 2026-07-15
A user running Qwen 3.6 27b locally noticed an anomaly: CPU usage was nearly maxed out, while GPU load hovered around only 20%.
They noted that models usually split loading between VRAM and RAM, which isn't uncommon, but the discrepancy this time was far worse than usual. The poster added that only Qwen 3.6 27b exhibits this severe CPU bottleneck, and asked for potential causes or fixes.
More from Infra
- Strangeworks launches Aura to turn enterprise ops into production optimization systems — whurley · 2026-07-22
- Graph workload 854.graph500 enters SPEC CPU 2026 as a new CPU benchmark — Prof_DavidBader · 2026-07-22
- HilbertRaum open-sources a fully local AI chat and document analysis app for private use — Vladowski · 2026-07-22
- Hybrid and local inference are emerging as a response to AI energy and token costs — dmitry140 · 2026-07-22
- NVIDIA details Vera CPU with 2x performance claims and a 22,000-core rack — ryanshrout · 2026-07-22
- NVIDIA says Vera Rubin NVL72 delivers 10x more tokens per megawatt than Blackwell — nvidia · 2026-07-22