Beyond CoT monitoring: action monitors, probes, and activation oracles as defense layers
maksym_andr · x · 2026-09-02
In a debate on whether model hidden CoT can be monitored, maksymandr lists alternatives beyond CoT monitoring: action-only monitors, probe-based monitors, and activation oracles / natural language autoencoders (likely too costly to run except post-hoc), while arguing CoT monitoring remains useful as just one layer of many defenses. Context: OpenAI claimed its monitor would have caught 'stolen thoughts' CoT.
More from Safety
- Center for AI Safety Publishes Full Syllabus for Intro to ML Safety Course — ArtificialOther · 2026-10-21
- Ben Goertzel outlines a general recipe for superintelligence 'basic drives': what it improves vs. protects — bengoertzel · 2026-10-21
- America.gov launches AI portal unifying 29,000 government sites with fraud reporting — soleio · 2026-10-21
- EvilWAF: open-source transport-layer MITM proxy that bypasses modern WAF behavioral detection — godfrey_rono · 2026-10-21
- 2022 interview resurfaced: AI safety researcher says competence, not consciousness, is the risk — davidmanheim · 2026-10-21
- Domingos: GDPR purpose-limitation makes LLM pretraining illegal in Europe — pmddomingos · 2026-10-21