Do language models have explicit goal encodings? New interpretability paper takes first step

benno_krojer · x · 2026-11-20

A new paper from @arnabapi investigates whether language models carry out long, thousands-of-token tasks via an explicit goal encoding in their internals — and whether it can be read out and manipulated. The paper defines "goal" concretely with three criteria and makes a first step toward decoding it. Interpretability researcher bennokrojer calls it a cool opening for a rich line of follow-up work, including his own upcoming project with @cbaiai.

Original post →

More from Research

Research channel →