CoT may be a misleading proxy: models can pass richer messages via KV cache
stochasticchasm · x · 2026-09-04
The author argues that even if chain-of-thought looks like a decent proxy for a model's internal process, it can be misleading: models can pass messages through the KV cache that are far more complex than what appears in token space, so readable CoT may not reflect what's happening inside the model.
Related event: Looped Transformer Rumors Spark Fierce Debate Over CoT Monitorability(7 posts)→
More from Research
- Skip the open access fees: NIH-funded papers must go on PMC with no embargo — anshulkundaje · 2026-10-21
- Creed: LLM code auditing infers developer beliefs to find semantic security flaws — mboehme_ · 2026-10-21
- ProVADA: one AI framework deimmunizes CD19 CAR binder and rescues cytosolic protease — BrianHie · 2026-10-21
- New paper formalizes embodied CoT faithfulness and uses it as an RL reward signal — drmapavone · 2026-10-21
- Custom quantization scheme found via greedy and evolutionary search, Pareto optimal — giffmana · 2026-10-21
- UC Berkeley open-sources SkyDiscover, an AI framework that evolves better algorithms and builds full systems — CShorten30 · 2026-10-21