Fable 5.2 reproduces outdated MazeBench solutions, sparking contamination suspicion

patience_cave · x · 2026-11-16

patiencecave reports Fable 5.2 solves puzzles suspiciously well: on a hard 3D level it produced the solution to an old version of MazeBench, updated weeks ago so the old fix no longer works—and the model stumbled there, though it could sometimes infer recent changes. xeophon and others ask: did Anthropic train on MazeBench? A classic suspected benchmark-contamination case.

Related event: Fable 5.2's Suspiciously Good Puzzle Solving Sparks Benchmark Contamination Concerns(2 posts)→

Original post →

More from Models

Models channel →