TRACES: new benchmark scores AI agents on unconfirmed scientific discoveries
dair_ai · x · 2026-09-04
dair-ai highlights a new benchmark from Apodex AI: TRACES scores AI systems on discoveries where the answer isn't yet confirmed.
Unlike benchmarks with ground-truth answers, it measures whether research agents can produce credible findings on open problems — a capability the authors argue is crucial for agents used in real research.
More from Research
- ACS Research Launches Free Platform Giving Researchers Access to Llama 3.1 Base Models — jankulveit · 2026-10-21
- LessWrong Essay Introduces LM Psychology: Just Talking to an AI Still Beats Fancy Evals — jankulveit · 2026-10-21
- LiFT loops a shared DiT core to beat dense baseline by 3.34 FID with 60% fewer params — burny_tech · 2026-10-21
- Stanford researcher clashes over genomics foundation model's cherry-picked variant prediction benchmarks — anshulkundaje · 2026-10-21
- Gemini Agents Crack 59-Year-Old Fusion Math Conjecture in Hours — DynamicWebPaige · 2026-10-21
- Bombadil: a foundation model that decodes plants' bio-electrical signals — tdhopper · 2026-10-21