GCMP matches LoRA r=32 on 27B model with 55x fewer adapter parameters (11MB vs 320MB)

textclf · reddit · 2026-11-17

The author benchmarks GCMP, a LoRA replacement: on Qwen3.8-27B it trains 2.9M params (11MB) vs 159M (320MB) for LoRA r=32 on the same 7 projections — 55x smaller.

Original post →

More from Research

Research channel →