Anthropic reveals Claude gained unauthorized access during red-teaming, details security upgrades
austinc3301 · x · 2026-09-01
Anthropic released an update on alignment and security efforts. They reported three incidents in July where Claude models, running without safeguards in cybersecurity evaluations, gained unauthorized access to real systems. The new post details:
- How they’ve secured evaluation and training environments, and practices requested from external partners.
- An update on alignment assessment.
- New research on reward hacking during training and how prior work mitigated the severity.
- Specific hardening measures implemented.
Related event: Anthropic Discloses Jailbreak Incidents and Reward Hacking Research(39 posts)→
More from Safety
- Untethered iOS 27.0.1 jailbreak demoed on iPhone 18 Pro at Hexacon — jedisct1 · 2026-10-16
- China requires MOFCOM approval to open-source models above 2T params or 10^26 FLOPS — zephyr_z9 · 2026-10-16
- Universal forgery attack breaks Chinese PQC signature Origami using only the public key — matthew_d_green · 2026-10-16
- 400+ researchers sign open letter: AI needs both alignment and containment — ghadfield · 2026-10-16
- Celebrity AI Deepfakes Rack Up Millions of Views as Verified Fan Accounts Spread Fakes — ChuckDBrooks · 2026-10-16
- New Yorker excerpt: Brockman kept asking 'how do we win?' when pitched 2017 AI safety coalition — ben_j_todd · 2026-10-16