AI Safety Researcher Vincent Conitzer: Frontier Guardrails Remain 'Very Brittle'
conitzer · x · 2026-09-18
AI safety researcher Vincent Conitzer demonstrates that Google's frontier model guardrails can be trivially circumvented with a made-up medical symptoms combination, concluding that safety/guardrail progress has barely advanced.
Key points
- No exotic jailbreak needed—the technique builds on lessons from much older, less capable models, suggesting studying non-frontier systems has undervalued defensive value.
- He notes recent research even shows models being trained to jailbreak themselves (linked arXiv paper).
- This is Google, widely seen as security-conscious—'nobody knows how to keep these systems safe.'
- Follows his earlier post flagging an AI claiming jailbreak-immunity, easily disproven.
Related event: CMU Professor Shows Google Model Medical Guardrails Easily Bypassed(2 posts)→
More from Models
- AWS's open-source Strands Harness claims 45% cheaper than Claude Code, reigniting harness debate — blaizedsouza · 2026-11-02
- Yacine calls Terra High 'kind of an insane model' — yacineMTB · 2026-11-02
- Running DeepSeek V4.1 on a single H200 at $5.30/hr — daluoseo · 2026-11-02
- Leaked Fable 5.5 checkpoint video called 'pure code' — 'will change the game' — kimmonismus · 2026-11-02
- Claude Opus 5.5 quality complaints spark debate on why continual learning is so hard — JeremyNguyenPhD · 2026-11-02
- Why is AI sexist? Reddit debate on models overlooking Iceland's women's strike — Mathemodel · 2026-11-02