Roon: alignment has seen no fundamental progress since RLHF as capabilities race ahead
ZealousidealBus9271 · reddit · 2026-10-13
Roon (@tszzl) argues there have been no fundamental advances in alignment since RLHF—most of the field remains "folk theory" rather than a scientific or engineering discipline—and that the prediction that capabilities would race far ahead of interp and alignment has come true.
Related event: Alignment stagnation debate erupts as OpenAI chief scientist weighs in(19 posts)→
More from AGI Musings
- a16z and Dan Boneh: AI's math leap could compress a decade of crypto trust-building into one month — a16z · 2026-10-14
- Who bears the burden of proof on AI doom? Accelerationists and doomers clash — AccBalanced · 2026-10-14
- MIT PhD Student Co-Authors Book Chronicling the Rise and Fall of the Tech Worker Movement — soumitrashukla9 · 2026-10-14
- Tim Sweeney asked if 5-minute AAA game generation would be good for humanity, sparks debate — max_paperclips · 2026-10-14
- MIT professor's ten predictions for AI for science, from executable papers to compiled matter — ProfBuehlerMIT · 2026-10-14
- Sweden spends hundreds of millions of kronor on printed textbooks as 2.8M-child study links screens to lower grades — Eric520CC · 2026-10-14