Fable 5.2's Suspiciously Good Puzzle Solving Sparks Benchmark Contamination Concerns
Fable 5.2 produced a solution matching an outdated version of MazeBench on a recently updated 3D puzzle, raising concerns that the benchmark leaked into its training data, though it sometimes inferred recent changes.
2026-11-16 ~ 2026-11-16 · 2 related posts
- Fable 5.2 reproduces outdated MazeBench solutions, sparking contamination suspicion — patience_cave · 2026-11-16
- Fable 5.2 reproduces outdated MazeBench solutions, sparking contamination suspicion — patience_cave · 2026-11-16