Qwen3.8-27B Q4 on an 8GB RTX 4060 scores 29/30 on AIME 2026 with three no-fine-tune loops

Ai_Glitch_3301 · reddit · 2026-11-19

Setup

Two weeks testing stock Qwen3.8-27B (UD-Q4KM GGUF, llama.cpp) on an 8GB RTX 4060 — no fine-tuning, pass@1, one seed, misses published. MTP draft head boosts speed 3.5→5.7 tok/s (+65%); only 1-in-4 layers keep KV, passing 60k-token recall within 8GB.

Plain model (thinking on)

Write-run-fix loops (thinking off, weights untouched)

Honest caveats

Code, prompts, logs: github.com/aiglitchsouls/loop27b

Original post →

More from Infra

Infra channel →