Does repeating layer stacks really kill CoT monitorability? Debating recurrent architectures vs just deeper models
andersonbcdefg · x · 2026-09-04
In a debate on CoT interpretability, @NathanCalvin argues it's plausible CoT monitoring is long-run doomed yet worth delaying as long as possible. andersonbcdefg pushes back: why does repeating a stack of N blocks twice "magically" destroy CoT monitorability, when it seems no different from making the model deeper — Meta's MobileLLM also repeats layers. Is it just "deep model bad"?
Related event: Looped Transformer Rumors Spark Fierce Debate Over CoT Monitorability(7 posts)→
More from Research
- ACS Research Launches Free Platform Giving Researchers Access to Llama 3.1 Base Models — jankulveit · 2026-10-21
- Embodied First Exam Benchmark Runs Coding Agents Through 1,090 Tasks on 44 Robots — ManlingLi_ · 2026-10-21
- LessWrong Essay Introduces LM Psychology: Just Talking to an AI Still Beats Fancy Evals — jankulveit · 2026-10-21
- LiFT Loops a Shared DiT Core: FID 3.34 Lower With 60% Fewer Parameters on ImageNet — burny_tech · 2026-10-21
- LiFT loops a shared DiT core to beat dense baseline by 3.34 FID with 60% fewer params — burny_tech · 2026-10-21
- SteerAct steers test-time features to boost robot manipulation without retraining VLA models — yining_hong · 2026-10-21