Comment: Self-Report Experiments May Be Overrated
voooooogel · x · 2026-07-14
This comment argues that the least convincing experiments in the paper feel more like a shift in "narrative register" rather than supporting the strong conclusions claimed by the authors.
The commenter speculates that a cluster of self-reporting expressions inherently exists within the pre-trained model and is triggered by default. Meanwhile, after post-training / RL, Claude developed a more stable self-reporting style tied to the so-called j-space mechanism. If j-space is ablated, the original "Claude style" vanishes, and the alternative pre-training register surfaces instead.
Nevertheless, it remains an interesting finding: Claude's self-reporting language does seem linked to j-space, though the experiment's actual conclusions might be weaker than what the paper emphasizes.
More from Research
- Spotting reward hacking in benchmarks is far harder than you think, says AI2 researcher — soldni · 2026-10-26
- RCT: ChatGPT temporarily boosts consultants' data science skills, gains vanish without it — EricTopol · 2026-10-26
- FocusVLA routes robot camera views by predicted interaction intent across task stages — iscas-cloud · 2026-10-26
- Transformers' biggest audio overhaul: unified AudioProcessor architecture — LysandreJik · 2026-10-26
- Free 195-page primer: The Little Book of Generative AI Foundations — caglar_ee · 2026-10-26
- SPADER from Zhejiang and Peking University Tops All Four Multi-Answer QA Benchmarks, Accepted at EMNLP — jiqizhixin · 2026-10-26