SciArena to Shut Down on July 15
allen_ai · x · 2026-07-16
Allen AI introduced SciArena, an evaluation platform designed to test how well AI models handle scientific literature questions, with researchers judging the answer quality.
The project will retire on July 15. It ultimately engaged around 1,700 名用户 who cast approximately 3,900 张票. They plan to use these results to compile researcher feedback on model answers.
Related event: Allen AI retires SciArena; o3 tops the science-QA leaderboard(6 posts)→
More from Research
- Mathematician Daniel Litt Launches Problem Repo to Track Human vs AI Progress: 15 Problems, 1 Solved — littmath · 2026-09-11
- Open ECDSA.fail challenge uses AI agents to shrink Shor's-algorithm quantum circuits for Bitcoin keys — StefanoGogioso · 2026-09-11
- Alex Townsend posts 200 open problems in numerical linear algebra for humans and AI agents — IgorCarron · 2026-09-11
- Navier-Stokes, Riemann, P vs NP: what this week's math buzzwords mean for you — koltregaskes · 2026-09-11
- Fruit fly brain as an LLM: connectome-driven language model demo goes live — ngxson · 2026-09-11
- Harry Collins: LLMs can't do frontier science because they can't invent new language — whoamisri · 2026-09-11