ICML Discussion: Don't Anthropomorphize Intermediate Tokens
rao2z · x · 2026-07-16
The repost highlights a summary of an ICML 2026 poster discussion titled "Stop Anthropomorphizing Intermediate Tokens", focusing on how we interpret "traces/intermediate tokens."
In their summary, the authors mentioned using Fable to transcribe and summarize raw/noisy audio from the live session, which worked quite well. The reposter emphasized that the phenomenon in question might be more akin to "inducing a distribution shift"—an effect that is empirically useful but difficult to explain intuitively.
Related event: ICML Poster Discussion: Stop Anthropomorphizing Intermediate Tokens(2 posts)→
More from Research
- Nature Physics: reprogrammable refractive index enables arbitrary multimode wave control for ML — MarioKrenn6240 · 2026-10-27
- Wakaru open-sources ontologize: labeling datasets from model activations — amplifiedamp · 2026-10-27
- EMNLP Oral paper traces multilingual representations in LLMs with cross-layer transcoders — ZhijingJin · 2026-10-27
- GPT-6 Pro reruns crime research: GTA V's 2013 launch tied to violence dips in four regions — emollick · 2026-10-27
- OpenAI's Aaron Lou on leaving a Stanford PhD for OpenAI, diffusion LMs vs autoregression — aaron_lou · 2026-10-27
- CLT-Forge: Open-source toolkit for cross-layer transcoder training and attribution graphs — ZhijingJin · 2026-10-27