Kokotajlo: open models mean the best AI ships with zero guardrails and no recall option
Afinetheorem · x · 2026-10-01
Responding to Zeynep Tufekci, Daniel Kokotajlo (Afinetheorem) offers a counterfactual on open-model safety: if OpenAI shipped its best model with zero guardrails or refusals, and with no way to pull it from the market or change those guardrails after release, most people would consider that unacceptable — yet that is effectively the status quo for open models, which are all jailbroken.
The argument defends the value of closed-model safety measures: post-release intervention and recall ability is itself a safety property the open ecosystem lacks.
More from AGI Musings
- Alpha School accused of "counseling out" low-gain students as founders push back on selection bias claims — benjaminjriley · 2026-11-16
- Netflix lands Joseph Gordon-Levitt's AI thriller with Rachel McAdams, sparking debate on AI apocalypse blockbusters — ShakeelHashim · 2026-11-16
- Caine Prize confirms 2026 winner amid AI-use allegations — ShakeelHashim · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16
- A diagram for judging quality in cultural artefacts: coded meaning and exemplary moves — round · 2026-11-16
- Economists argue humans will be fine without work: jobs were just reputation and friendship engines — paulnovosad · 2026-11-16