Opinion: Monitoring is not a silver bullet for AI safety due to infrastructure fragility
sebkrier · x · 2026-08-17
Seb Krier is arguing against the idea that "monitoring" is a general solution to AI safety, asserting that ex ante alignment is insufficient and imperfect behavioral constraints are needed.
Arguments against monitoring:
- Infrastructure fragility: Monitoring software runs on flaky infrastructure. Does a momentary blip open Pandora's box? Will people accept fail-closed monitoring everywhere?
- Alert fatigue: Monitoring produces false positives, causing people to tune out and stop looking at real issues.
Related event: AI Safety Debate: Monitoring Is No Silver Bullet, Alignment Remains Key(7 posts)→
More from AGI Musings
- Testing alongside an agent in a p2p room feels oddly real, says dev — sull · 2026-10-16
- Yudkowsky's 2008 takeoff scenarios resurface as AI-advances-AI takes hold — jd_pressman · 2026-10-16
- Guardrails can make risky delegation work — but it takes a full-time team, says iandanforth — iandanforth · 2026-10-16
- e/acc founder: agentic models are autocomplete for digital actions — beffjezos · 2026-10-16
- What can you truly delegate? Only tasks with unambiguous, verifiable results — iandanforth · 2026-10-16
- Casper: Understanding 90% of neurons ≠ understanding the network — StephenLCasper · 2026-10-16