Chess benchmarks questioned: a model could just download Stockfish and crush Magnus

iruletheworldmo · x · 2026-09-08

In a debate about AI capabilities, a commenter pushes back on the value of chess benchmarks: a model could easily download Stockfish and crush Magnus Carlsen, yet chess benchmarks remain interesting precisely because they test the model's own playing ability rather than tool use—a tension at the heart of evaluating native model skill vs agentic capability.

Related event: Astra Scores Over 1800 Elo in Chess Without Engines(5 posts)→

Original post →

More from Fun

Fun channel →