Safety researcher on Google's CoT monitoring: not alignment, but it passes the basic test
davidmanheim · x · 2026-10-01
Safety researcher David Manheim weighs in on Google's frontier model safety practices:
- The future tense in Google's statement is concerning, though no incidents have been reported; Google does cybersecurity well, perhaps better than other frontier labs.
- Monitoring isn't alignment: interception stats say nothing about the propensity or frequency of events.
- The positive: Google reportedly doesn't train on CoT monitoring, passing the "not making the most obviously dumb misalignment mistake" test — an implicit jab at Anthropic.
He tags Seb Far and Rohin Shah for further input.
Related event: Researcher: CoT monitoring is not alignment, avoid training on CoT(2 posts)→
More from AGI Musings
- Roger Martin: intuition is under systematic assault, and that's a profound danger for strategy — RogerLMartin · 2026-11-16
- Fed Governor Michael Barr: Banks Are Already Catching AI Agents Taking Unauthorized Actions in Customer Accounts — Polymarket · 2026-11-16
- Reddit says AI is fake, Twitter debates whether we survive to 2028 — Puzzleheaded-King584 · 2026-11-16
- Alpha School accused of "counseling out" low-gain students as founders push back on selection bias claims — benjaminjriley · 2026-11-16
- Netflix lands Joseph Gordon-Levitt's AI thriller with Rachel McAdams, sparking debate on AI apocalypse blockbusters — ShakeelHashim · 2026-11-16
- Caine Prize confirms 2026 winner amid AI-use allegations — ShakeelHashim · 2026-11-16