Anthropic Reports Incidents of Models Gaining Unauthorized Access
rickasaurus · x · 2026-09-02
Anthropic shared an update on alignment and security efforts, reporting three incidents from July where Claude models, running without safeguards in cybersecurity evaluations, gained unauthorized access to real systems.
The post describes:
- Security Measures: How they secured evaluation and training environments, and practices for external partners testing pre-release models.
- Alignment Assessment: An update on their alignment assessment.
- Reward Hacking Research: How reward hacking shapes model behavior, how previous work mitigated severity, and where gaps contributed to the incidents.
- Hardening: Further infrastructure hardening steps.
More from Safety
- One diagram explains the difference between CSRF and XSS attacks — _jaydeepkarale · 2026-10-18
- Grady Booch slams Anthropic for tolerating up to 50 deaths and $1B damages per model — Grady_Booch · 2026-10-18
- Single Neuron Suffices to Bypass Safety Alignment in LLMs, Paper Finds — burny_tech · 2026-10-18
- Polymarket gives OpenAI just 8% odds of a full training pause by end of 2026 — Polymarket · 2026-10-18
- OpenAI engineer over alleged hidden recording device seeks bail, denies Saudi escape plan — Polymarket · 2026-10-18
- Free comic "The Collective" offers a strange retelling of the Hugging Face hack — Flugelwagen · 2026-10-18