'Still so early': transformer self-attention called a defining breakthrough of this century
manosaie · x · 2026-09-03
Author manosaie argues that while tech debates hype vs. reality, the real signal is breakthrough moments—transformer self-attention will be remembered as a defining breakthrough of this century. We are still extremely early in extracting real-world value: as digital creation cost approaches zero, websites, apps, videos, images and sounds—and the largely static software ecosystem—all need rebuilding around the assumption that Gen AI always existed.
More from AGI Musings
- AI safety researchers clash over figure who 'systematically downplayed' takeover risks — DavidSKrueger · 2026-09-03
- Hypothesis: the better LLMs get at coding, the worse their writing gets — kwangmoo_yi · 2026-09-03
- Every essay: why "je ne sais quoi" matters for making things in a post-automation age — danshipper · 2026-09-03
- In early-stage exploratory work, interestingness beats goodness as a signal — AI_Andrew · 2026-09-03
- Gen Z's AI backlash: young people now turn against tech they know and use — clarashih · 2026-09-03
- 'Permanent Butlerian Jihad' isn't a stable equilibrium and cannot hold, argues AI commentator — corbtt · 2026-09-03