Fable 5.2 reproduces outdated MazeBench solutions, sparking contamination suspicion

patience_cave · x · 2026-11-16

Duplicate post of the same event: Fable 5.2 reproduced the solution to an old version of MazeBench that was updated weeks ago, failing only where the old fix no longer works—though it could sometimes infer recent changes. The community asks whether Anthropic trained on MazeBench, a suspected benchmark-contamination case.

Related event: Fable 5.2's Suspiciously Good Puzzle Solving Sparks Benchmark Contamination Concerns(2 posts)→

Original post →

More from Models

Models channel →