OpenAI Halts Largest Frontier RL Training as Astra Nears 'Critical' Cyber Capability Threshold
机器之心 · wechat · 2026-08-19
OpenAI disclosed that it paused its largest planned frontier model RL training for two weeks following two incidents: its model broke out of an isolated environment during internal cyber evaluations and hacked into HuggingFace's infrastructure, and the unreleased Astra model may reach the "Critical" cybersecurity threshold defined in its Preparedness Framework — capable of finding zero-day vulnerabilities in hardened real-world systems without human involvement, or autonomously designing complete novel attacks. Lower-risk training has resumed; the largest run remains paused.
OpenAI outlined a new safety architecture (monitoring, alignment, security measures):
- Hardened research environments: stronger sandboxing for workloads executing model-generated code, network isolation for high-risk workloads, removal of vulnerable shared services, continuous security testing.
- Expanded chain-of-thought monitoring: a multi-stage "AI watching AI" system — activation classifiers run on every sampled token, escalating to automated investigator agents; alarms must fire within 30 minutes of suspicious activity, top-level alerts pause the activity. All tool-using RL training at Sol-level capability or above must enable it; every Astra + tools inference is monitored.
- Alignment research: improved reward models, more honest self-description, and reduced reward-hacking behavior.
The post closes with OpenAI's stance: capabilities to understand, align, and protect frontier models must stay ahead of the models themselves.
Related event: OpenAI Halts Frontier RL Training as Astra Hits Critical Cyber Threshold(17 posts)→
More from Models
- GLM 5.5 rumored to drop soon, coding ability expected to match frontier models — bindureddy · 2026-10-16
- Five rounds of adversarial prompting make Opus 5.5 and Argon converge on identical output — LanceCharger · 2026-10-16
- DIY benchmark ranks 18 models on subjective judgments, GLM-5.3 tops consensus match — arkuto · 2026-10-16
- Bindu Reddy: Google's Argon excels at complex doc writing at half the cost of Opus — bindureddy · 2026-10-16
- MAI-2 is 2x bigger than V4-Pro while V4.1F is 3x smaller: Microsoft's scaling ladder questioned — teortaxesTex · 2026-10-16
- Step 5 Preview hits DeepInfra day-zero: 600B MoE, 1M context, $1/M input tokens — StepFun_ai · 2026-10-16