Independent Reproduction Confirms Recirculation Cuts Gemma 3 Perplexity

Independent researchers reproduced the Recirculation method on Gemma 3 1B, confirming that injecting source layer 11 into target layer 4 reduces perplexity by about 23% without fine-tuning.

2026-08-28 ~ 2026-08-28 · 2 related posts

• Reproducing Recirculation: Gemma 3 PPL Drops 23% Without Fine-tuning — CatAstro_Piyush · 2026-08-28
• Gemma 3 1B reproduction confirms PPL drop in Recirculation experiment — allenainie · 2026-08-28