Qwen3.8-27B crawls at 5 tokens/s on 8GB VRAM + 32GB RAM: best config?
SoAp9035 · reddit · 2026-08-15
A Reddit user asks for help: running Qwen3.8-27B on a consumer rig with 8GB VRAM + 32GB RAM yields only about 5 tokens/s.
They want recommended settings/configs to squeeze out the best possible speed on this hardware, and whether usable speeds are even achievable — a typical local-LLM deployment tuning question.
More from Infra
- Drama3 TTS lands in audio.cpp: up to 5x real-time on RTX 5090, <8GB VRAM mode too — Acceptable-Cycle4645 · 2026-10-16
- Drama3 TTS lands in audio.cpp: up to 5x real-time on RTX 5090, <8GB VRAM mode too — Acceptable-Cycle4645 · 2026-10-16
- Three CoreWeave co-founders have sold $3.3B in shares since IPO amid credit worries — SumitGup · 2026-10-16
- Cherry pi on a Raspberry Pi: the tiny-model rumor developers are watching — sull · 2026-10-16
- CoreWeave's debt costs falling: DDTL spreads tightened from S+9.62% to S+2.25% — BenBajarin · 2026-10-16
- SoftBank lines up US IPOs for SB Energy and AI robotics spinoff Roze, valuations top $50B — nordicinst · 2026-10-16