Looped Transformers will blow up in 2026, researcher predicts, mocking AI's slow trends

prajdabre · x · 2026-08-01

A researcher playfully mocks the delayed adoption of AI architectures, noting that while Noam Shazeer introduced MoEs in 2016, they only exploded in popularity in 2024. He predicts the same 8-year lag for Looped Transformers, introduced in 2018, forecasting their breakthrough by 2026.

Original post →

More from Fun

Fun channel →