Margaret Mitchell clarifies disputed paper was about pretrained base models

mmitchell_ai · x · 2026-09-28

Hugging Face researcher Margaret Mitchell clarified amid a debate with @BlancheMinerva and @MelMitchell1 that her paper explicitly concerns "pretrained" and "unsupervised" LMs, not post-trained models.

She added that while there are important discussions to be had about post-training's role in model-internal representations, the paper's stated focus was base models — urging critics to judge based on the text of the paper itself.

Related event: Melanie Mitchell Clarifies "Stochastic Parrots" Debate: Today's AI Is No Longer LLMs(31 posts)→

Original post →

More from Models

Models channel →