FMF and AI Security Institute release framework for rating jailbreak risk
HZoete · x · 2026-11-06
FMF (@fmforg) has published a preliminary framework offering a shared method for rating successful jailbreaks by potential risk, drawing on expertise across its member organizations.
The UK AI Security Institute (@AISecurityInst) contributed to the framework, calling it an important addition to technical best practice. The motivation: as AI cyber capabilities evolve, it's critical to understand how safeguards can be bypassed.
Related event: Frontier Model Forum and AISI Release Jailbreak Risk Rating Framework(2 posts)→
More from Safety
- Sentinel Bio's Joshua Monrad on DNA screening, uplift studies and agent monitoring — The Cognitive Revolution · 2026-11-06
- Interview teaser: Why China embraces AI more than America, and the open-weight strategy — panickssery · 2026-11-06
- Miles Brundage cites METR: Anthropic will pack 4 months of progress into 2 before Congress — nitarshan · 2026-11-06
- Ajeya Cotra: redacted evidence undermines AI risk verification and safety cases — ajeya_cotra · 2026-11-06
- Vinod Khosla: AI plus quantum computers will break most encryption before 2030 — rohanpaul_ai · 2026-11-06
- Yale study: ChatGPT recommended a Senate candidate in 79% of political chats — luisdans · 2026-11-06