Running Qwen3.8-27B for coding on 32GB VRAM — what local LLMs do you use and why?
theexile1337 · reddit · 2026-09-08
A Redditor describes running Qwen3.8-27B (Q4/Q6 depending on context needs) for coding on a 32GB VRAM rig, plus Gemma4 31B for research and general queries to avoid sending data to cloud models. They ask whether a site exists for comparing local LLMs by use case and invite others to share their model/quantization/VRAM setups.
More from coding & agent
- Agent verified 'success' after double-voting: a lesson in harness vs model bugs — TejasKumar_ · 2026-10-26
- diginomica: agentic automation hype is overdone, and 'The Hackening' of enterprise security has begun — jonerp · 2026-10-26
- 'Vibe verification': ~60% of AI-written formal specs prove the wrong property — basedjensen · 2026-10-26
- Devin launches Security suite powered by Claude Mythos with $100M+ credits — DevinAI · 2026-10-26
- HackBench injects reward hacks into agent trajectories to stress-test monitors — DanielKhashabi · 2026-10-26
- Hugging Face ships hf CLI updates: deduped cache saves 19GB, faster buckets, retryable GPU jobs — yb2698 · 2026-10-26