Entropy doesn't track what matters in chain-of-thought, BlackboxNLP paper finds
gsarti_ · x · 2026-10-23
A paper by SaraCandussio, danielsc4 and gsarti (accepted to the BlackboxNLP reproduction track, presenting at EMNLP Oct 29, 16:00–17:00) tests whether entropy tracks what's important in a chain of thought — and finds it mostly doesn't, identifying the spurious cause behind why it previously appeared to. The authors will present at BlackboxNLP.
More from Research
- 20+ ICLR 2027 Submissions Found With Fabricated Results, Sparking Reproducibility Critique — srchvrs · 2026-10-23
- Qdrant's 64-byte-per-page recipe: 128x compression with 99.2% retrieval quality — qdrant_engine · 2026-10-23
- Qdrant benchmarks Cohere Embed 5 Pro: one dense vector per PDF page vs ColPali — qdrant_engine · 2026-10-23
- 20+ ICLR 2027 submissions self-confess fabricated placeholder results — thegautamkamath · 2026-10-23
- Pure FP vs C: Roc's DEFLATE grind closes in on libdeflate's performance — johnlindquist · 2026-10-23
- rosinality Fixes Numerical Precision Issues in Softmax, Praised by Lucas Beyer — giffmana · 2026-10-23