A single web search makes LLM inputs OOD, argues developer
menhguin · x · 2026-09-20
Following up on the stochastic parrot debate with Jack Clark, @menhguin gives a concrete example: even a simple prompt asking the model to browse 1-2 webpages pushes the input far out of distribution, producing novel OOD trajectories — his argument that RL-trained LLMs are no longer mere "stochastic parrots".
More from AGI Musings
- Researcher: Alignment Community Should Debate the Strongest Arguments, Not the Loudest Critics — RichardMCNgo · 2026-09-20
- Researcher: Good Work Doesn't Speak for Itself, Marketing Does — A_K_Nain · 2026-09-20
- Stanford AI professor Yejin Choi to headline Korea Society ethics and common values lecture series — stanfordnlp · 2026-09-20
- Frontier Token Costs Make It Hard for Low-Purchasing-Power Countries to Compete — Paimaamu · 2026-09-20
- Debate: Freeze frontier AI now, or is that just regulatory capture? — GarrisonLovely · 2026-09-20
- Josh Gans' AI doomer joke: the species AI wipes out isn't humans, it's New Caledonian crows — joshgans · 2026-09-20