Loopie: A Looped Transformer with Fewer Parameters

teortaxesTex · x · 2026-07-20

Satire on the paper Loop the Loopies! but the substance: the authors propose Loopie, a looped Transformer. Claims: under same wall-clock training time and matched inference compute budget, Loopie beats non-looped baselines while needing roughly one third fewer parameters and optimizer states. The work comes from the AI research division of Beijing quant fund Ubiquant.

Related event: Loopie Cyclic Transformer Matches 30B Baselines with Fractional Tokens(7 posts)→

Original post →

More from Companies & People

Companies & People channel →