Dev challenges "stochastic parrot" critics: a transformer with a shell — how many lines until it's one?
BlancheMinerva · x · 2026-09-27
A developer pushed back at Mel Mitchell: his setup is "just a transformer with access to the command line and the ability to run programs", with no input or output processing. He asks whether the stochastic-parrot assessment hinges on the training method — RL vs next-token prediction vs SFT vs teacher-student logit matching — and challenges critics to name the fewest lines he could delete to keep it a parrot.
More from AGI Musings
- Floridi et al. prove AI can't have guaranteed correctness and open-ended generality at once — rvp · 2026-09-27
- Dev Claim: Open Models on Consumer Hardware Can Handle 99.9% of AI Use Cases — ostrisai · 2026-09-27
- Anthropic's AI biolab deploys ~950 agents for 21 hours, finds CRISPR-like DNA in viruses — rvp · 2026-09-27
- Prof. Dietterich: Scaling Wasn't All You Needed — Data, RLVR and Harnesses Mattered — tdietterich · 2026-09-27
- AI access breaks creators' feedback loops, argues OpenAPS founder — scottleibrand · 2026-09-27
- GenAI Makes Producing 10x Easier, but Good Stuff Only 10% Easier — charles_irl · 2026-09-27