Yoav Goldberg: The BERT Paper, Not Transformers, Was the True Precursor of Modern NLP
yoavgo · x · 2026-10-06
Weighing into a debate over whether the original Transformer paper was overrated as academic work, Yoav Goldberg argues that BERT was the real precursor of a new generation of NLP — and what made Transformers genuinely cool in the field's eyes.
Related event: Researchers Debate the True Starting Point of the Modern AI Era(6 posts)→
More from AGI Musings
- AI safety researchers debate whether evidence-based iteration implicitly relies on prediction checking — davidmanheim · 2026-10-06
- The 'Claude black hole': agent social graphs may reorient around one giant cluster — Kyrannio · 2026-10-06
- 'Microtubules don't matter': dev argues the brain is a computer and free will is no mystery — ctjlewis · 2026-10-06
- Waymo skepticism conflates real taxi growth with a fantasy taxi service, argues Timothy B. Lee — binarybits · 2026-10-06
- As capabilities grow, opinion on AI consciousness will drift from sceptics — dioscuri · 2026-10-06
- Researcher: Labs aim for RSI, token burn is a byproduct not a conspiracy — HanchungLee · 2026-10-06