Looped transformers are back: a professor points to the 2016 paper that started it
CSProfKGD · x · 2026-10-07
Cornell professor Kilian Q. Weinberger notes that "looped" transformers are all over his feed and points back to a 2016 paper where he first saw the idea of looping in neural networks — what's old is new again.
Related event: Looped Transformer Trend Traced Back to Older Papers(3 posts)→
More from Research
- Hidden Chain-of-Thought Extracted from GPT-6 and Claude via Standard API Tool Calling — jiqizhixin · 2026-10-07
- Information-Dense Synthesis cuts molecular discovery experiments from O(d) to O(log d) — anshulkundaje · 2026-10-07
- UCLA finds hybrid-attention layer ordering shapes multilinguality — alternative orders learn 2.5X faster — UCLA · 2026-10-07
- NYU's RGPO uses adaptive rationale scaffolding to fight reward sparsity in RL for reasoning — newyorkuniversity · 2026-10-07
- UCLA aligns cross-lingual representations in decoder-only LLMs via MoE router outputs — UCLA · 2026-10-07
- 12M+ RL task entries on HF Hub, browsable via new RL Environment Explorer — SergioPaniego · 2026-10-07