Qwen 27B quant runs on 8GB VRAM: 200k context, 92.5% Top-1 vs BF16

Brief-Tap-6616 · reddit · 2026-11-21

A Reddit user released a 2.1bpw quant of Qwen3.8 27B (AmperInteger+/Trellis format) that actually works on 8GB GPUs, supporting 200k context with 92.5% Top-1 match against BF16 and coding scores within 10% of full precision — 17% above the 9B quant.

Original post →

More from Infra

Infra channel →