Loopback Transformer: separate controls over input strength and update weight beat baselines with 40–75% fewer parameters

uw-madison · hf · 2026-11-16

A paper from UW–Madison, UCSB, Caltech and Microsoft introduces the Loopback Transformer, unifying the view of residual looped transformers.

Original post →

More from Research

Research channel →