$1M into a public benchmark gets labs to spend $100M+ hillclimbing it

_jasonwei · x · 2026-11-20

Mercor CEO Brendan Foody observes that investing $1M in a public benchmark drives labs to spend $100M+ hillclimbing it, citing rapid model gains on benchmarks built with Harvey, Cognition, Sierra and Ramp over 6 months.

Jason Wei extends the point: when AI can optimize anything we quantify, much of coming value creation will come from inventing new ways to measure the world — benchmarks are becoming an industry of their own.

Original post →

More from AGI Musings

AGI Musings channel →