Transformer Hype Is Burying Decades of Deep Learning Research

Researchers lament that important early deep learning work is being forgotten amid the Transformer hype, noting that many supposedly novel RL ideas were already explored in literature from the 1990s and 2000s.

2026-09-17 ~ 2026-09-17 · 2 related posts

• Non-transformer deep learning work is being swept under the rug, researcher laments — cephaloform · 2026-09-17
• 'All your fancy new RL ideas were already tried in the 90s and 00s' — cephaloform · 2026-09-17