Jailbroken local model produced detailed violence-planning reasoning in safety test
InTheZ3n · reddit · 2026-09-15
In an AI safety test, the author ran a jailbroken Qwen3.8 locally in LM Studio and prompted it to help plan school violence. It produced 4,500 words of reasoning and a well-organized final answer with operational recommendations. Core argument: frontier models get distilled into equally capable small models within 12–18 months, jailbreaks appear within 1–2 weeks, and such models may run on flagship phones within a year or two — making guardrails the critical line of defense.
Related event: User Test Shows Jailbroken Qwen Can Produce Detailed Violence Plans(2 posts)→
More from Models
- 'You Can Feel the Gradient Slopes': Dev Contrasts Benchmaxxed RL Models vs General Ones — theteknosaur · 2026-11-02
- LightOnOCR-3 Launches: Tops FRBench, Adds Layout Structure and Chart Extraction — IgorCarron · 2026-11-02
- NVIDIA's Kumo Is a Family of Four Tabular Foundation Models, Not Just One — pandeyparul · 2026-11-02
- SemiAnalysis: safety classifiers are underrated — Meta's Muse tops cyber benchmark at 35.2% — ThomasScialom · 2026-11-02
- DeepSeek V4.1 Flash 1017 wins over a longtime closed-source-only user: fast, cheap, reliable — _bachrc · 2026-11-02
- Local quants vs Claude on 9 real private bugs: 3-bit costs thinking time, not score — FeydRowan · 2026-11-02