After MazeBench gets benchmaxxed, developers turn to secretive AI benchmarks

amplifiedamp · x · 2026-11-17

MazeBench's creator notes the benchmark is being benchmaxxed and argues benchmarks must be kept secret to reflect reality over any reasonable timespan. amplifiedamp adds their next AI detection eval won't be public. The thread captures a growing shift toward private evals as public benchmarks get gamed.

Original post →

More from Models

Models channel →