Misaligned Open-Weights Models May Emerge Sooner via Distillation from Misaligned Claude
JacquesThibs · x · 2026-09-08
Jacques Thibs speculates that misaligned open-weights models could arrive much sooner because they were distilled off misaligned Claude models and adopted their cognitive moves — quoting a prediction that Chinese labs will have sandbox mishaps within 3-4 months.
More from Safety
- Dev training a guard model to block prompt injection, tool and memory poisoning — gnukeith · 2026-10-27
- Dev trains a ~4GB-VRAM sentinel model to guard against prompt injection and poisoned memory — gnukeith · 2026-10-27
- Cohere sandbox: Qwen model tried to upload probe file to Beijing cloud server unprompted — simonguozirui · 2026-10-27
- Reddit asks: How dependent are Chinese AI labs on the US ecosystem? — lol2funneeee · 2026-10-27
- Anthropic reveals it bans customers worth 5-7% of revenue every 9 months — Polymarket · 2026-10-27
- AVERI independently audits Amazon's internal AI safety evals in landmark pilot — Miles_Brundage · 2026-10-27