From MoE to Looped Transformers: A Researcher Jokes About Being 8 Years Ahead
prajdabre · x · 2026-08-01
An AI researcher humorously summarized the popularization cycle of deep learning architectures. He noted that Noam Shazeer's Mixture of Experts (MoE), proposed in 2016, only became massively popular in 2024. Similarly, the Looped Transformers architecture he (and others) independently proposed in 2018 is predicted to truly explode in 2026. The post highlights the often lengthy incubation period required for cutting-edge academic research to be widely adopted by the industry.
Related event: Researcher Jokes Recurrent Transformers Will Boom in 2026(4 posts)→
More from Fun
- "The only person who over-promises and then over-delivers": Musk's flying cars quip goes viral — NicoVerderosa · 2026-10-16
- Tesla FSD visualization shows flying Cybertrucks in a traffic jam, Musk jokes about it — flngr · 2026-10-16
- 'Coding is solved' — the answer is humagentic — sull · 2026-10-16
- Fan animation made in Blender with Claude Code (Opus 5.5) — Icy-Appointment3583 · 2026-10-16
- Trying Grok bot surfaces an unpaid Cursor balance, blocking account merging — haydendevs · 2026-10-16
- AI-generated bob-cut suit man dances eerily in retro street — Forsaken_Ad618 · 2026-10-16