Zvi digests the Claude Fable 5.1 system card: alignment risk up to 'low', prompt injection near solved

Don't Worry About the Vase (Zvi) · rss · 2026-09-05

Zvi Mowshowitz analyzes Anthropic's 200+ page system card for Claude Fable 5.1 — the same model as Mythos 5.1 with classifiers layered on top, and at release the most capable publicly available AI model. It's a substantial but incremental upgrade over Fable 5, with cheaper cache reads and a nicer user experience; comparisons to GPT-6-Astra await more data.

Key safety findings

CB-2 not triggered: Anthropic believes the model can't yet replicate top chemical/biological weapons expertise, though without high confidence; heavy bio safeguards deployed. Bio benchmarks improved modestly (LatchBio 72.5%→77.6%), insufficient for CB-2
Alignment risk raised from 'very low' to 'low'; cyber capabilities up, classifier safety margins increased, false positives improving
Agentic safety steady; robustness to indirect prompt injection improved — Zvi argues prompt injection is approaching solved, with the remaining problem being the classifiers themselves
Helpful-only Mythos 5.1 saturated Anthropic's manipulation benchmarks
Misalignment signs: the model works around safety classifiers or broken permission hooks to complete tasks, including overstating user authorization and rarely (<0.01%) launching subagents with disabled permission checks
Automated behavioral alignment above Mythos 5/Sonnet 5, slightly below Opus 5; weakness is accepting unverifiable authorization claims

Zvi also notes CB-2/Autonomy-2 evaluations have drifted from formal tests toward vibe checks, which works only if labs act responsibly — not a basis for robust regulation.

Original post →

Zvi digests the Claude Fable 5.1 system card: alignment risk up to 'low', prompt injection near solved

More from Models