Qwen 27B 3.8 low quantization tested: Q3 XXS works well locally
jeremyckahn · reddit · 2026-08-24
The author shares test results of highly quantized Qwen 27B 3.8 models on limited hardware (Mac mini M4 24GB).
- Performance: Using Unsloth's Q3 XXS quant, the model makes minor mistakes but can work autonomously towards a goal for hours.
- Context: Context window size is around 180k.
- Verdict: For users with lower-end GPUs, this level of quantization is reliable for completing tasks. The author asks if others have had success with sub-Q3 quants.
More from Models
- Google says teams across the company are using Gemini 4 Argon on its hardest engineering problems — CurieuxExplorer · 2026-10-15
- Perplexity's new embedding models: index with a 9B model, search with 0.6B — antoine_chaffin · 2026-10-15
- 797GB of n-gram counts in CPU RAM let 1B models match 57% more compute — PangWeiKoh · 2026-10-15
- Leak: Moonshot's Kimi flagship 'x4' done with pre-training, K3.1 in internal testing — lyraxana · 2026-10-15
- Unsloth ships GGUF quants for Nemotron 3.5: Bolt-74B runs in 24GB RAM — danielhanchen · 2026-10-15
- NVIDIA ships two open Nemotron 3.5 Bolt models: a 74B-A9B MoE and a mobile-friendly E4B — HankYeomans · 2026-10-15