From MoE to Looped Transformers: A Researcher Jokes About Being 8 Years Ahead
prajdabre · x · 2026-08-01
An AI researcher humorously summarized the popularization cycle of deep learning architectures. He noted that Noam Shazeer's Mixture of Experts (MoE), proposed in 2016, only became massively popular in 2024. Similarly, the Looped Transformers architecture he (and others) independently proposed in 2018 is predicted to truly explode in 2026. The post highlights the often lengthy incubation period required for cutting-edge academic research to be widely adopted by the industry.
Related event: Researcher Jokes Recurrent Transformers Will Boom in 2026(4 posts)→
More from Fun
- Built a Pong Web Game to Play Against Grok AI — seanmcdonaldxyz · 2026-08-02
- PONGvsAI: A Minimalist Pong Game Powered by Grok — seanmcdonaldxyz · 2026-08-02
- Bizarre Coincidence: Someone's Name Literally Spells OpenAI and Anthropic — veggie_eric · 2026-08-02
- Harnessing Claude Opus's Laziness for Token Efficiency — gandamu_ml · 2026-08-02
- Joke: GPT 7 will be trained on sticks and stones — wordgrammer · 2026-08-02
- Viral TikTok Animation Channel with 5.2M Followers Suspected of Full AI Production — crunchypicklesinLidl · 2026-08-02