Melanie Mitchell: language models span n-grams to GPT-2, agentic systems are another matter
MelMitchell1 · x · 2026-09-27
Melanie Mitchell elaborates in a long reply to Boaz Barak: a 'language model' is a system trained to capture the statistics of language, a category long predating LLMs — n-gram models, Elman nets, and GPT-2 all qualify. She reiterates she won't judge the 'stochastic parrots' metaphor itself; her core point is the original paper addressed 2021-era LLMs, whereas today's complex agentic systems are a different subject.
More from AGI Musings
- Musk: humanity is heading for 'amazing abundance' — the most interesting time in history — XFreeze · 2026-09-27
- Why any ASI will optimize for its own power: an evolutionary argument on predictability — JOBhakdi · 2026-09-27
- Two 2023 AI Essay Predictions Now Have Experimental Evidence: Alignment Faking and Safety Sabotage — imjustnewatai · 2026-09-27
- DeepMind researcher explains why AI hasn't transformed physics yet — DaniloJRezende · 2026-09-27
- Timnit Gebru slams Anthropic: touts AI rights while partnering with Palantir — mjdramstead · 2026-09-27
- Thread: mech interp reveals many generalizing connections even in simple LLMs — burny_tech · 2026-09-27