Recirculation Architecture Reduces Perplexity Across Gemma3 Models

xennygrimmato_ · x · 2026-08-20

Demonstrates the reduction in perplexity across the Gemma3 model series when using the Recirculation architecture. Comparisons show that the Recirculation transformer achieves lower perplexity than the Unrolled loop transformer.

Related event: Recirculation Architecture Cuts Perplexity Across Model Families(3 posts)→

Original post →

More from Research

Research channel →