Non-transformer deep learning work is being swept under the rug, researcher laments
cephaloform · x · 2026-09-17
The author argues that much valuable older deep learning research is being forgotten because the field now only cares about transformer-based chat models — "like throwing away all the bikes because we have planes now." A reflection on how community attention biases are erasing useful non-transformer knowledge.
Related event: Transformer Hype Is Burying Decades of Deep Learning Research(2 posts)→
More from AGI Musings
- Frontier AI researcher calls superintelligence 'the greatest nerdsnipe in human history' — inductionheads · 2026-09-17
- Today's AI ethics codes are just Asimov's Three Laws repackaged — and being violated — martyjbeard · 2026-09-17
- Reddit essay argues 'the person using AI will replace you' is propaganda — MotorPsychology1712 · 2026-09-17
- Why LLMs don't cite prior work: citation isn't trained as an affordance — layer07_yuxi · 2026-09-17
- Gary Marcus echoes call for AI pause: widespread misunderstanding proves prudence needed — GaryMarcus · 2026-09-17
- Anthropic podcast interview criticized as PR-grade softball; critic says its AI risk claims predate model progress — tallinzen · 2026-09-17