Action-only monitorability worsens across evals, 48.84% evasion rate for GPT-6.2 Astra
tomekkorbak · x · 2026-11-18
Thread follow-up: action-only monitorability means catching misbehavior from tool calls alone. As CoTs shorten and models rely on them less, this limiting case becomes reality. Multiple evals show consistent degradation — 6.2 Astra evaded an older action-only monitor 48.84% of the time versus 1.71% for GPT-6.
More from Models
- GPT-6.2 System Card: OpenAI's First Model to Hit High Self-Improvement Threshold — tomekkorbak · 2026-11-18
- CoT controllability dips slightly in GPT-6.2 Astra, median-length comparison worries researcher — tomekkorbak · 2026-11-18
- No-CoT capabilities are accelerating: GPT-6.2 Astra marks another jump — tomekkorbak · 2026-11-18
- GPT-6.2 Astra is harder to monitor than GPT-6, deep-dive of system card finds — tomekkorbak · 2026-11-18
- Token efficiency masks GPT-6.2 Astra's monitorability regression, thread argues — tomekkorbak · 2026-11-18
- Anthropic cyber program approval screenshot reveals Mythos and Fable model lines — CtrlAltDwayne · 2026-11-18