DeepMind/Kaggle $25k Prize Award Disputed
TheWerkmeister · reddit · 2026-07-18
The author disputes the judging results of the Google DeepMind sponsored Kaggle competition “Measuring Progress Toward AGI - Cognitive Abilities”, arguing that a highly flawed submission won the $25,000 prize.
The post focuses on compiling evidence regarding the fairness of the award:
- The goal was to design a new AI benchmark based on cognitive science
- The author claims the analyzed work intended to show an LLM different perspectives on 5 statements and observe if it changed its attitude
- However, the final submission was a massive "collage" far exceeding the required format, filled with inadequate arguments
- The author further questions whether the judges actually read the methods, code, and data carefully
The organizers stated that the review followed the rules and is ultimately a matter of subjective judgment.
More from Safety
- Researcher quits Anthropic, says OpenAI and Anthropic are racing to self-improving superintelligence — ShakeelHashim · 2026-09-11
- Why So Many AI Researchers Think the Machines Could Kill Everyone — wiredmagazine · 2026-09-11
- California creates standards for independent AI auditors to verify lab safety testing — VraserX · 2026-09-11
- a16z podcast: why 2-3 person startups are absent from policy debates — a16z Podcast · 2026-09-11
- Researcher questions AI safety eval firm, citing 'blatantly sloppy' security and monitoring — Kyrannio · 2026-09-11
- Class action accuses Anthropic of overselling Claude subscriptions with deceptive usage multipliers — The Decoder · 2026-09-11