AI researchers are rediscovering 2019 BERT papers from first principles
sebgehr · x · 2026-09-22
Developer Daniel Aumiller notes the AI field is "rediscovering 2019 BERT papers from first principles," and sebgehr amplifies it, saying Alex and @kchonyc were "way ahead of their time" — many of today's hot ideas trace back to years-old research.
More from Research
- Math isn't as open as claimed: NSA kept differential cryptanalysis secret since 1974 — lpachter · 2026-09-22
- New Blog Explores Group Theory Meets Deep Learning with Interactive Sphere Visuals — CatAstro_Piyush · 2026-09-22
- Qonto open-sources QontoFAQ, a retrieval benchmark closer to real product Q&A — espadrine · 2026-09-22
- Podcast: Epoch AI researcher on RSI, robotics, China model gap, and open vs closed safety — natolambert · 2026-09-22
- Xiaomi's Luo Fuli Recaps MiMo-V2.6 RL Run: 25K Agent Trajectories Per Step — bookwormengr · 2026-09-22
- Winning robotics: deploy early and lean on collaborative perception instead of chasing reliability — broodsugar · 2026-09-22