LoRA merge + requantize fix boosts Qwen3.8B speed ~50% with zero syntax fails

yb2698 · x · 2026-11-20

bchap1n shared a reproducible local-model fix: merge the LoRA adapter into weights (llama-export-lora) → hybrid GGUF → requantize to IQ4XS (14.2 GiB) with llama-quantize --allow-requantize, keeping MTP and q80 KV @160K.

A/B results (control sandwich, same prompts): the merged config hits 86.6/85.9 tok/s (standard/coding) with tldrScore 10.0/10.0 and zero syntax fails, versus 57.6 tok/s and 3x syntax failures for the original pi-lora setup — a 50% speedup with better output quality.

Original post →

More from Infra

Infra channel →