Companies should build their own benchmarks instead of relying on public leaderboards

simonguozirui · x · 2026-11-10

In a discussion on model evaluation, alexgshaw argues companies should build their own internal benchmarks rather than relying on public leaderboards — claiming that's the only approach that encourages broadly good models, since public indices invite benchmark gaming.

Original post →

Companies should build their own benchmarks instead of relying on public leaderboards

More from Models