What Is Old Is New Again: Jev and Looped Transformers Revive Classic AI Ideas

bendee983 · x · 2026-09-26

Connecting last week's Jev and 'system one' model discussions with the recent looped transformer trend (GPT-6 Astra), the author argues AI keeps revisiting old ideas: from specialized models to GPT-3's few-shot paradigm, everything-tokenized autoregression, then reasoning models and scale — and now back to small, specialized, non-autoregressive models that reason in latent space via recurrent loops. Revisiting old ideas can open new directions for innovation.

Original post →

More from Models

Models channel →