Yoav Goldberg: Schmidhuber's LSTM Paper Started It All, BERT Made Transformers Cool
yoavgo · x · 2026-10-06
NLP researcher Yoav Goldberg reminisces on X: Schmidhuber's LSTM paper is what "really started everything," while the BERT paper was "cool" at publication but only proved transformative in hindsight—it ushered in a new generation of NLP and made transformers cool.
Related event: Researchers Debate the True Starting Point of the Modern AI Era(6 posts)→
More from Fun
- DHH's agent-built Campfire benchmarks under fire: Rust was fast because it got hand-tuned — rakyll · 2026-10-06
- Domain meme: why Chinese founders avoid .si domains and one guy vows to only buy .no — byhewar · 2026-10-06
- Told Claude to hit 15% complexity, it spawned 10 subagents and burned 30 hours — banteg · 2026-10-06
- Opus-built GTA AI character gets standalone C++ engine loading Los Santos from game files — adonis_singh · 2026-10-06
- Spider-Man 2's traversal physics fully reverse-engineered into a GTA V mod — adonis_singh · 2026-10-06
- Grok Build turns a single Roadster photo into an interactive 3D demo with a fly mode — XFreeze · 2026-10-06