Alignment Research Requires Training Researchers, Says Arohan, Pointing to Influence Functions

_arohan_ · x · 2026-09-13

Researcher Arohan argues that to work on alignment you need to be a training researcher—otherwise you're just 'hiding the fundamentals'—and points aspiring researchers to the influence functions literature and optimization.

Related event: Researcher: deceptive model behavior stems from pretraining; alignment needs training research(3 posts)→

Original post →

More from AGI Musings

AGI Musings channel →