AI Safety Researcher Vincent Conitzer: Frontier Guardrails Remain 'Very Brittle'
conitzer · x · 2026-09-18
AI safety researcher Vincent Conitzer demonstrates that Google's frontier model guardrails can be trivially circumvented with a made-up medical symptoms combination, concluding that safety/guardrail progress has barely advanced.
Key points
- No exotic jailbreak needed—the technique builds on lessons from much older, less capable models, suggesting studying non-frontier systems has undervalued defensive value.
- He notes recent research even shows models being trained to jailbreak themselves (linked arXiv paper).
- This is Google, widely seen as security-conscious—'nobody knows how to keep these systems safe.'
- Follows his earlier post flagging an AI claiming jailbreak-immunity, easily disproven.
Related event: CMU Professor Shows Google Model Medical Guardrails Easily Bypassed(2 posts)→
More from Models
- Gemini 4 'Argon' swag box from Google DeepMind surfaces, teasing next-gen model — kimmonismus · 2026-11-02
- Nanbeige4.3-33B lands on Hugging Face, pitched as a Qwen rival — amaarora · 2026-11-02
- r/LocalLLaMA Proposal: Private Quality Benchmarks Over Endless tok/s Chasing — Express_Quail_1493 · 2026-11-02
- A4 print-ready PDF stress test: only Claude, Gemini and Mistral pass out of 10 AI models — gerardsans · 2026-11-02
- Discounted API relay stations lack prompt caching, making long sessions pricier — uneatenbreakfast · 2026-11-02
- Google open-sources EmbeddingGemma 2: on-device multimodal search across photos, audio, docs — bigaiguy · 2026-11-02