Redwood proposes transparency rules as architectures risk removing chain-of-thought monitorability
RyanGreenblatt · x · 2026-09-11
Redwood Research published a proposal addressing a growing safety concern, backed by Ryan Greenblatt and others:
- Core worry: architectures that push reasoning into opaque activations ("neuralese") or drop chain-of-thought entirely would remove the main handle for monitoring AI reasoning.
- Concrete case: Greenblatt argues that based on limited public evidence, Google's Astra was a concerning step in this direction, yet public information is insufficient for an informed debate on the monitorability-vs-performance trade-off.
- The proposal: companies should disclose no-CoT reasoning abilities, other monitorability evidence, and publish policies for preserving monitorability.
A rare, concrete transparency framework aimed at a specific product architecture.
Related event: Redwood Research Proposes Disclosure Rules to Protect CoT Monitorability(5 posts)→
More from Safety
- Google DeepMind pilots world's first double-blind evaluations for frontier models — scychan_brains · 2026-10-26
- LLM back-of-envelope estimate puts PHP vulnerability impact at $1bn–$4bn — S_OhEigeartaigh · 2026-10-26
- US states halt new data centers as 72% of Americans oppose local builds — YvesMulkers · 2026-10-26
- LEMON: zero-shot LLM misbehavior monitor flags hallucinations from attention maps — yoavartzi · 2026-10-26
- a16z podcast: Diode pairs AI PCB design with Brooklyn factory to revive US hardware manufacturing — MattPerault · 2026-10-26
- Cybersecurity meme: the real threat is 'Steve from IT,' not superintelligence — McDonaghMatthew · 2026-10-26