Alignment Research Requires Training Researchers, Says Arohan, Pointing to Influence Functions
_arohan_ · x · 2026-09-13
Researcher Arohan argues that to work on alignment you need to be a training researcher—otherwise you're just 'hiding the fundamentals'—and points aspiring researchers to the influence functions literature and optimization.
More from AGI Musings
- The 130-140 IQ doom loop: why some smart people can't be optimistic — djcows · 2026-09-13
- Smarter or cheaper? Revenue data keeps picking the smarter model every time — teortaxesTex · 2026-09-13
- A classic British show's power logic perfectly explains today's AI governance debates — bilawalsidhu · 2026-09-13
- Hamkins calls AI math usefulness "essentially zero" as others hail 8 months of historic change — lpachter · 2026-09-13
- Robin Hanson: AI Pause Regs May Be Market Leaders Blocking Rivals, Jezos Agrees — TinfoilTricorn · 2026-09-13
- Andrew Ng Video Slams AI Fear Mongering: 'A Dishonest Agenda Is Being Implemented' — AIandDesign · 2026-09-13