Melanie Mitchell calls Stochastic Parrot critiques strawmen; lu_sichu pushes back
burny_tech · x · 2026-09-27
- Melanie Mitchell argued critiques of the Stochastic Parrots paper are strawmen: the paper addressed 2021-era LLMs, not today's AI systems with extensive post-training and external software components.
- lusichu countered that the paper's claims (§5, §6.1) were in-principle arguments about systems trained on form—fn. 22 already notes embedding an LM in a larger system doesn't grant communicative intent. If the argument fails for modern systems, it must be because they're no longer form-trained, not because it's 2026—unless midtraining, RL and pipeline changes actually overturn it.
- The exchange continues the long-running debate over whether LLMs possess genuine understanding or communicative intent.
More from AGI Musings
- "Mathematics is Effectively Dead": essay extends Daniel Litt on AI and the future of math — burny_tech · 2026-09-27
- Researcher's AGI definition: Astra and Opus are already near the bar — burny_tech · 2026-09-27
- Blogger argues ASI is existential risk: even 10 extra IQ points across trillions of agents would doom us — JOBhakdi · 2026-09-27
- Gary Bernhardt: Assembly will never be a good language for AI agents — mgill25 · 2026-09-27
- Doctor's thread: AI beats doctors who use AI on medical reasoning, human-in-loop can hurt — jonc101x · 2026-09-27
- Hinton: AI will only work with brain-like computation; free energy advocates disagree — mjdramstead · 2026-09-27