'BERTology' Page Sparks Nostalgia for BERT's Golden Era

Maxime Labonne resurfaced Hugging Face's dedicated 'BERTology' page, sparking nostalgia among researchers who recalled spending a month in 2019 learning BERT's WordPiece tokenization during BERT's dominance of NLP.

2026-09-19 ~ 2026-09-19 · 2 related posts

• BERT was so big in 2020 that Hugging Face had a 'BERTology' docs page — maximelabonne · 2026-09-19
• Nostalgia thread: learning BERT's WordPiece took a whole month back in 2019 — MaziyarPanahi · 2026-09-19