Nate Silver: Ignore AI benchmarks that labs already know in advance
soumitrashukla9 · x · 2026-09-12
Statistician Nate Silver doubled down on his view that AI benchmarks known to labs and models in advance deserve almost no attention. He clarified he is very impressed by AI capabilities—to the point of being worried—but that judgment comes from everyday use, not leaderboard scores.
More from AGI Musings
- The smartest AI safety and e/acc people are far more nuanced offline than on Twitter — danfaggella · 2026-09-13
- Sam Altman backs Dario's frontier pacing call, pledges independent evaluators — but logits access history resurfaces — MaziyarPanahi · 2026-09-13
- Researchers: AI developers must show real-life benefits to earn trust — dhadfieldmenell · 2026-09-13
- Altman and Musk appear to side with Dario on frontier AI pacing — Hesamation · 2026-09-13
- Sam Altman, Elon Musk and Dario Amodei all agree on pacing the AI frontier — altryne · 2026-09-13
- Mollick: Anthropic and OpenAI's clearest hints yet that some form of recursive self-improvement has been achieved — emollick · 2026-09-13