Will Transformers dominate until the 2040s? Deep dive on architecture evolution
Concern-Excellent · reddit · 2026-08-15
A Reddit discussion analyzes alternatives to Transformers (SSMs, KAN, JEPA) and their limitations in reasoning and scaling. The author argues Transformer variants will remain dominant for 1-2 decades due to ecosystem growth, while next-gen paradigms like world models may emerge in the 2040s with unlocked compute.
More from AGI Musings
- AI circle's new timeline meme: singularity in 2023 would be perfect timing, but it's coming 2027 — EigenGender · 2026-08-15
- AI winners won't be the smartest, but those owning irreproducible assets — VraserX · 2026-08-15
- The Guardian: AI and GLP-1 reflect an era of joyless decadence — nordicinst · 2026-08-15
- More Grammar for a Semantic Domain, More We Talk About It: A Linguistic Perspective — abenitezburraco · 2026-08-15
- Myth and Ontology: The Craftsman God's Names and Existence — repligate · 2026-08-15
- StackOverflow monthly questions plummet to 1,304 as AI kills public Q&A, study finds — 机器之心 · 2026-08-15