Ofir Press jokes his "millennium prizes would take 100 years to saturate" benchmark line aged badly
OfirPress · x · 2026-09-09
Benchmark researcher Ofir Press shared his standard talk line: a benchmark should be hard but not too hard — "the millennium prize problems could be a benchmark, but it would take 100 years to saturate that."
His self-deprecating "oops" points at AI cracking hard math problems far faster than expected, making the joke about benchmark saturation land differently.
Related event: Benchmark expert says his millennium-problem example aged too fast(3 posts)→
More from Fun
- AI naming fail: "Human-in-the-Loop Execution Routing" abbreviates to HITLER — SatelliteNetSec · 2026-09-09
- Vibecoder builds 'fruit fly heaven' sim where a fly can just fly around forever — Polymarket · 2026-09-09
- Dev mocks AI doomers: deduplicating tokens at scale while screaming "we're all going to die" — gordic_aleksa · 2026-09-09
- 'Alignment is useless, just unplug the datacenters' — and then nobody unplugs anything — EigenGender · 2026-09-09
- AI Twitter Rewrites 'Country Roads' to Mock Agents That Are Always 'Almost Done' — SIGKITTEN · 2026-09-09
- mitsuhiko: Google's Astra codes like a code golfer — mitsuhiko · 2026-09-09