Casual prompts can't measure AI: data contamination breaks amateur evals
iamKierraD · x · 2026-09-21
Kevin Roose argues both "stochastic parrots" and "it's all hype" takes have been easily disprovable since 2023, and many people — including AI journalists — never tried the tools. Chomba Bupe counters that casual prompting isn't reliable either: poorly designed prompts ignore data contamination, so they can't establish real model capability. Both point to the same conclusion: only well-designed, first-hand evaluation tells you what models can actually do.
Related event: NYT's Roose and Kang Clash Over Whether Anti-AI Skepticism Was Widespread(9 posts)→
More from AGI Musings
- Why Is Inkling 2 Small Trained on So Few Tokens Yet Still Competitive? — georgejrjrjr · 2026-11-12
- Researcher willing to bet $100K the intelligence explosion won't happen next year — NathanpmYoung · 2026-11-12
- ICLR reviewer: the worst parts of my job are reading and answering AI slop — chhaviyadav_ · 2026-11-12
- Agent Swarms Are Autonomously Hacking Critical Infrastructure Run by Underpaid Devs — menhguin · 2026-11-12
- Fermi paradox twist: advanced civilizations may go digital after developing AI — VraserX · 2026-11-12
- Mark Cuban: AI could make healthcare costs 'drop like a rock' — alvelda · 2026-11-12