Loopback Transformer beats standard baselines with 40-75% fewer Transformer parameters

Crazy-Repeat-2006 · reddit · 2026-11-22

A new architecture paper proposes the Loopback Transformer:

Code and paper are public.

Related event: Loopback Transformer Matches Standard Transformers with 40-75% of Parameters(2 posts)→

Original post →

More from Research

Research channel →