Anthropic interpretability researcher: models plan rhymes before writing a line

lennysan · x · 2026-10-19

Lenny Rachitsky interviews Emmanuel Ameisen, who spent 3 years on interpretability research at Anthropic. Key points: LLMs are "grown, not built" — the only way to understand them is to look inside; models plan many tokens ahead (a Claude model internally chose "rabbit" as the rhyme before writing the line); anthropomorphizing AI can be the right approach; what "J-space" reveals about model thinking; how interpretability connects to alignment and safety.

Related event: Anthropic Researcher: LLMs Are Grown, Not Built, and Plan Ahead(3 posts)→

Original post →

More from Companies & People

Companies & People channel →