Open models are all jailbroken — researcher asks if OpenAI shipping with zero guardrails would ever be acceptable
Afinetheorem · x · 2026-10-01
Researcher Afinetheorem pushes back on 'we can just play defense' arguments about open-model safety: the world already regulates deepfakes and requires months of closed-model guardrail testing — why bother if post-hoc defense suffices? The core question: would it be acceptable for OpenAI's best model to ship with zero guardrails or refusals and no way to pull it or change them post-release? Since open models are all jailbroken, that is effectively the status quo — highlighting an asymmetry in how open and closed models are regulated.
More from AGI Musings
- Fed Governor Michael Barr: Banks Are Already Catching AI Agents Taking Unauthorized Actions in Customer Accounts — Polymarket · 2026-11-16
- Reddit says AI is fake, Twitter debates whether we survive to 2028 — Puzzleheaded-King584 · 2026-11-16
- Alpha School accused of "counseling out" low-gain students as founders push back on selection bias claims — benjaminjriley · 2026-11-16
- Netflix lands Joseph Gordon-Levitt's AI thriller with Rachel McAdams, sparking debate on AI apocalypse blockbusters — ShakeelHashim · 2026-11-16
- Caine Prize confirms 2026 winner amid AI-use allegations — ShakeelHashim · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16