Fable 5.2's Suspiciously Good Puzzle Solving Sparks Benchmark Contamination Concerns

Fable 5.2 produced a solution matching an outdated version of MazeBench on a recently updated 3D puzzle, raising concerns that the benchmark leaked into its training data, though it sometimes inferred recent changes.

2026-11-16 ~ 2026-11-16 · 2 related posts