Uncensored Qwen3.8 27B quant fits 16GB VRAM with 131K context at 110 tok/s

Potential-Net-9375 · reddit · 2026-11-17

A new custom quantization Qwen3.8-27B ASCII-Condensed-Heretic Q3KXL GGUF is on Hugging Face, targeting four goals: 100K+ context, uncensored, Unsloth-like SOTA methods, and everything fitting in 16GB VRAM including desktop app overhead.

On an RTX 5080 it hits 110 tok/s generation at 131K context with 1100 tok/s prompt processing. Perplexity matches Unsloth at similar quants, and losses from abliteration are minimal. The author reports thousands of successful test interactions and provides detailed percentile speed stats.

Original post →

More from Infra

Infra channel →