Does repeating layer stacks destroy CoT monitorability? Safety researchers debate model depth
voooooogel · x · 2026-09-04
A debate on why repeating a stack of N blocks twice supposedly destroys CoT monitorability, when it seems no different from making the model deeper—Meta's MobileLLM also repeats layers. The steelman: the more capable a model is internally, the less it needs to verbalize scheming, so smaller models must externalize eval awareness more. But the author concedes this is effectively a generalized argument against any model scaling that adds depth.
Related event: Looped Transformer Rumors Spark Fierce Debate Over CoT Monitorability(7 posts)→
More from Safety
- CVSS 10.0 RCE in PHP core: critical patches land Oct 21, PHP 8 only — cyb3rops · 2026-10-21
- Anaconda ships MCP to stop coding agents from hallucinating malicious dependency packages — anacondainc · 2026-10-21
- Skip the open access fees: NIH-funded papers must go on PMC with no embargo — anshulkundaje · 2026-10-21
- Creed: LLM code auditing infers developer beliefs to find semantic security flaws — mboehme_ · 2026-10-21
- Spotify removed 50M+ AI slop tracks from recommendations in a year to back human artists — moustaki · 2026-10-21
- METR signs off on Anthropic's risk report but experts demand quantified uncertainty and neutral evals — DKokotajlo · 2026-10-21