Reddit asks: why can AI firms censor models so strictly yet fail to stop jailbreaks?
mikehocalate · reddit · 2026-10-27
A Reddit user poses the question: AI companies can impose strict guardrails and censorship on models, yet can't keep them from being jailbroken or causing harm. The thread touches on a core alignment tension — refusing harmful requests and constraining actual model behavior are two very different engineering problems.
More from Models
- Photographer finds ChatGPT now refuses watermark removal after earlier doing it easily — moisesg88 · 2026-10-27
- Why can text models draw letters? ASCII art in training data may be the answer — giffmana · 2026-10-27
- Gemini 4 Flash surfaces internally, codenamed 'Hydrogen', expected soon — koltregaskes · 2026-10-27
- A hands-on local-model benchmark: porting an old screensaver to Python OpenGL with Qwen 3.8 — prusswan · 2026-10-27
- The Chinese open-weight release pattern: same architecture, big gains via post-training — bendee983 · 2026-10-27
- Dessa full-duplex speech-to-speech model runs on consumer GPUs, dubbed a 'GPT-3 moment' for speech — Puzzleheaded-King584 · 2026-10-27