Resolution launches new Agent Foundations team to carry on MIRI's rigorous AI alignment theory

geoffreyirving · x · 2026-09-04

Resolution has announced a new Agent Foundations team — Jeremy Gillen, Abram Demski, Sam Eisenstat, Scott Garrabrant, and Kaarel Hänni — continuing the research spirit of MIRI's Agent Foundations team now that MIRI has pivoted to policy. The team aims to build theory for understanding minds, arguing AI lacks the engineering-grade ability to reason precisely about unseen scenarios, and to ground questions about how ASI would behave after learning, self-modification, and interaction with other agents. Current projects include understanding concepts (building on Condensation), trust and legitimacy, and better foundations for game theory. Geoffrey Irving welcomed the move, stressing that rigorous alignment research remains essential alongside empirical patchwork and governance work.

Related event: Resolution Launches Agent Foundations Team to Carry On MIRI-Style Alignment Research(2 posts)→

Original post →

More from Safety

Safety channel →