Researcher: RSI Debate Misses Hidden Variable of Human Data and RL Environment Scaling
novasarc01 · x · 2026-11-10
Seth Karten argues the RSI debate overlooks a critical hidden variable: everyone watches how fast agents solve new tasks and saturate benchmarks, but few adjust for how much human data and RL environment creation effort is being scaled up. Apparent progress may partly reflect amplified investment rather than self-improvement — "the goose was not valued," he warns, calling for investment-adjusted measures of AI progress.
More from AGI Musings
- 1985 Whole Earth Review cover: "Computers as Poison" mirrors today's AI debates — beffjezos · 2026-11-10
- A decade of Cambridge students now run FAR AI, METR, UK AISI and GovAI — S_OhEigeartaigh · 2026-11-10
- Comic argues AI scientists will write the next chapter of science, not humans — YogeshMalik · 2026-11-10
- "Alignment" is semantically overloaded — taboo the word to argue clearly — Sauers_ · 2026-11-10
- Creator vows to quit AI-generated content: 'AI really feels like AI, not human' — Abhishekcur · 2026-11-10
- doty clarifies the scaling debate: the point is against hardcoding human priors, not abandoning algorithms — dotey · 2026-11-10