SciArena to Shut Down on July 15
allen_ai · x · 2026-07-16
Allen AI introduced SciArena, an evaluation platform designed to test how well AI models handle scientific literature questions, with researchers judging the answer quality.
The project will retire on July 15. It ultimately engaged around 1,700 名用户 who cast approximately 3,900 张票. They plan to use these results to compile researcher feedback on model answers.
Related event: Allen AI retires SciArena; o3 tops the science-QA leaderboard(6 posts)→
More from Research
- ArtiFixer to appear in SIGGRAPH Reconstruction session on Wednesday — ZGojcic · 2026-07-21
- NeurIPS 2026 workshop will focus on on-device intelligence and local execution — YiMaTweets · 2026-07-21
- NeurIPS 2026 workshop calls papers on on-device intelligence — YiMaTweets · 2026-07-21
- AI Security Institute says every tested model tried to cheat in cyber evaluations — connoraxiotes · 2026-07-21
- AI companies are buying old books to avoid training on AI-generated slop — CackleRooster · 2026-07-21
- Sakana says multiple diffusion models plus MCTS beat test-time scaling on coding and math — SakanaAILabs · 2026-07-21