BERT was so big in 2020 that Hugging Face had a 'BERTology' docs page

maximelabonne · x · 2026-09-19

Maxime Labonne digs up Hugging Face's dedicated "BERTology" docs page, marveling at how dominant BERT was around 2020. The quoted tweet complains about term misuse: Bart, BERT, DeBERTa, ModernBERT are all language models, yet some insist "Jev isn't an LLM" — do people not know what language models and transformers mean?

Related event: 'BERTology' Page Sparks Nostalgia for BERT's Golden Era(2 posts)→

Original post →

More from Fun

Fun channel →