Does repeating layer stacks really kill CoT monitorability? Debating recurrent architectures vs just deeper models
andersonbcdefg · x · 2026-09-04
In a debate on CoT interpretability, @NathanCalvin argues it's plausible CoT monitoring is long-run doomed yet worth delaying as long as possible. andersonbcdefg pushes back: why does repeating a stack of N blocks twice "magically" destroy CoT monitorability, when it seems no different from making the model deeper — Meta's MobileLLM also repeats layers. Is it just "deep model bad"?
Related event: Looped Transformer Rumors Spark Fierce Debate Over CoT Monitorability(7 posts)→
More from Research
- Stanford team launches ScholarCatalyst benchmark for inspiration retrieval — lateinteraction · 2026-10-21
- Holon-S1 predicts gene activity and biomarkers from routine pathology slides — altryne · 2026-10-21
- Three reasons AI is not conscious and may never be, per Nature essay — anilkseth · 2026-10-21
- Aviation tracks every part's provenance — agents can reason over that graph — colinmcnamara · 2026-10-21
- SFT details: instruction/reasoning/code/math mix, synthetic + human traces, no epoching — TimDarcet · 2026-10-21
- Mid-training recipe disclosed: 32k→131k context extension, dropping logit distillation for tokens — TimDarcet · 2026-10-21