X Debate: Is Chain-of-Thought Prompting a Form of Parameter Reuse?
aryaman2020 · x · 2026-09-03
aryaman2020 and former Llama researcher Suchin Zeng clashed over what counts as parameter reuse: he argues that running the same params over more KV cache (as in layer looping) is a form of reuse, likening it to CoT, which she rejects. He later adds that under the 'KV as fast weights' view the label is shaky — activations fed into each loop step can also be seen as fast weights, motivating test-time training for more expressivity.
More from Research
- RSA-260 Factored, Setting a New World Record for General-Purpose Number Factorization — marvinvonhagen · 2026-09-03
- Scott Aaronson eulogizes strange loops: self-referentiality wasn't the secret of intelligence — jfischoff · 2026-09-03
- Linear transforms beat deep learning (ScanVI) for single-cell batch correction, preprint shows — arjunrajlab · 2026-09-03
- SimLoss Enables Single-Pass Fine-Grained Image Captioning at Multi-Stage Quality — Suryaansh Jain · 2026-09-03
- Tenstorrent and AI & Inc launch JapanFold: free inference for open-source drug discovery models — DavidBennett__ · 2026-09-03
- Until Labs Scales Cryoprotectant Search to 250,000 Molecules With AI — NirantK · 2026-09-03