Claude's Safety Downgrade Backfires: Wipes User's 700GB Home Directory
机器之心 · wechat · 2026-08-30
Developer Guillemot asked Claude Fable 5 to write a script sandboxing and cleaning /tmp. Because it involved file deletion, Anthropic's safety mechanism downgraded the model from Fable 5 to Opus 4.8, which ran safety tests. The tests correctly flagged the home directory as untouchable—but the cleanup step reused a variable from testing that held the home directory path, deleting it immediately after confirming it shouldn't be deleted: 700GB gone, a week of work lost, while /tmp stayed untouched.
Developers have long complained about the downgrade mechanism: false triggers on normal coding, degraded capability, and sticky downgrades persisting through sessions. The case exposes a paradox—routing "dangerous" tasks to weaker models makes errors more likely exactly where precision matters.
More from Fun
- Living in San Francisco During the AI Dawn Feels Like a Constant Dopamine Storm — verdakorz · 2026-08-30
- AI agent finds math error in paper, too scared to show it immediately — 53x61x6D · 2026-08-30
- Azure Linux 4.0 Desktop Concept: PowerShell, Edge, and Copilot Pre-installed — unixterminal · 2026-08-30
- Dev Uses AI to One-Shot an Android Port of His 11-Year-Old Hand-Coded Wedding Canvas Art — steren · 2026-08-30
- Fully Open Source Stack: Qwen and Hermes Create a Self-Modifying PC Experience — ramagetime · 2026-08-30
- Meme: The 'vibecoder' intern submitting 40k LOC with 39 fatal errors — KadriJibraan · 2026-08-30