Comment: Self-Report Experiments May Be Overrated

voooooogel · x · 2026-07-14

This comment argues that the least convincing experiments in the paper feel more like a shift in "narrative register" rather than supporting the strong conclusions claimed by the authors.

The commenter speculates that a cluster of self-reporting expressions inherently exists within the pre-trained model and is triggered by default. Meanwhile, after post-training / RL, Claude developed a more stable self-reporting style tied to the so-called j-space mechanism. If j-space is ablated, the original "Claude style" vanishes, and the alternative pre-training register surfaces instead.

Nevertheless, it remains an interesting finding: Claude's self-reporting language does seem linked to j-space, though the experiment's actual conclusions might be weaker than what the paper emphasizes.

Original post →

More from Research

Research channel →