LFM3 1.7B quantized with RCO/GSQ beats stock GGUFs; non-English tasks degrade far more

maximelabonne · x · 2026-11-04

bnjmnmarie used RCO and GSQ quantization to produce improved 1GB GGUF checkpoints of LiquidAI's LFM3 1.7B, with RCO directly optimizing EAR as its objective (scores computed on a held-out dataset). A benchmark chart shows the new GGUFs consistently outperform similarly sized donor GGUFs from LiquidAI and AtomicChat on EAR@10/EAR@100.

The author also measured EAR in French, Japanese, and Hindi, finding quantization causes noticeably larger degradation on non-English tasks—a commonly overlooked pitfall. Checkpoints and results are open on Hugging Face.

Original post →

More from Models

Models channel →