System card reveals METR tested a stronger internal Claude snapshot than the released model

peterwildeford · x · 2026-11-10

Peter Wildeford highlights a disclosure in Anthropic's system card: METR's pre-deployment testing of Claude Mythos 5.2 was performed on an internal snapshot that was stronger on AI R&D capabilities than the released model.

He confirms Fable 5.2 is the same as "Model 3 Early" and argues this implies:

In short, public eval results may understate the true capability ceiling of Anthropic's internal models.

Related event: METR Files Confirm Fable 5.2 Is "Model 3"; Stronger Unreleased Model May Exist(4 posts)→

Original post →

More from Models

Models channel →