Snorkel AI Expands Open Benchmark Grants 10x to $30M, Adds Red Team
ajratner · x · 2026-10-12
Snorkel AI is expanding its Open Benchmark Grants to a $30M commitment (10x), alongside an Open Benchmarks Red Team and a Snorkel Research Fellowship for independent evaluation researchers.
- Partners include teams behind Terminal-Bench, TB-Science, ARC-AGI-3, OSWorld 2.0, Agents' Last Exam, Senior SWE-Bench, and more
- The thesis: more robust, continuously-updated, diverse and independent open benchmarks prevent overfitting ("benchmaxxing") and keep public evaluation useful
- The company still does private benchmarks and human+automated evals for labs and enterprises, but argues open visibility into frontier AI is critical for research, safety/alignment, and societal oversight
More from Research
- "Results Without Understanding" Is How LLMs Work—and Science Itself Is Changing — fkasummer · 2026-10-12
- The classic VAE tutorial that bridges deep learning and probabilistic modeling — goyal__pramod · 2026-10-12
- Anesthesia blocks consciousness via quantum microtubule effects, Stuart Hameroff argues ahead of Tucson conference — JosephJacks_ · 2026-10-12
- DeepMind's SynthID Bio protein watermarks now verifiable on Proteinbase — davidstutz92 · 2026-10-12
- Mathematicians push back on OpenAI's model-generated proofs — ZeeshanZiaML · 2026-10-12
- GaussiAnimate turns 4D captures into rigged 3D assets without physics simulation — janusch_patas · 2026-10-12