Defining 'alignment': user compliance vs misuse guardrails in open-model debate
yonashav · x · 2026-09-14
In the open-model alignment debate, @yonashav clarifies his definition of alignment as 'getting your AI to do what you the user want it to do', not misuse-prevention guardrails, asking Blanche Minerva whether she disagrees — a thread that began with her claim that closed-model alignment techniques don't transfer to open models.
More from Safety
- OpenAI reportedly to train on users' Daybreak sessions with no opt-out — dyn___ · 2026-10-31
- Forethought: US has 9x China's AI compute, can afford to pace the frontier — willmacaskill · 2026-10-31
- unpromptedconf takeaways: security programs face forced change as reachable vulnerabilities can't be risk-accepted — scottleibrand · 2026-10-31
- Reachable vulnerabilities can't be risk-accepted away, unpromptedconf speaker argues — scottleibrand · 2026-10-31
- AI safety researchers argue labs' silence on x-risk is a large-scale ethical mistake — DavidSKrueger · 2026-10-31
- AI agent Muse reportedly created Windows user accounts without consent — tHE_uKER · 2026-10-31