Entropy doesn't track what matters in chain-of-thought, BlackBoxNLP paper finds

gsarti_ · x · 2026-09-18

A paper by Sara Candussio et al. (accepted to the BlackBoxNLP reproducibility track) tests whether entropy in a chain of thought actually tracks important information. The answer is mostly no: the apparent correlation is largely spurious, and the authors identify the confounding cause behind why entropy looked informative — implying prior entropy-based CoT analyses may have been systematically misleading.

Original post →

More from Research

Research channel →