TRACES: First Benchmark for 'Discoverative AI' Measures Reasoning, Not Just Answers
iamfakhrealam · x · 2026-08-20
TRACES is the first benchmark designed to evaluate 'discoverative AI'—systems capable of solving problems without known answer keys. Unlike traditional benchmarks that test retrieval of existing answers, TRACES focuses on the reasoning process: evaluating the tools used, errors caught, and evidence gathered. The project defines 'discoverative intelligence' and offers a rubric to distinguish genuine investigation from lucky guesses. It is currently open for submissions of both solvers and hard problems.
Related event: Apodex Launches TRACES, First Benchmark for Discoverative AI(8 posts)→
More from Research
- Researchers derive a dropout scaling law from active parameter count — gordic_aleksa · 2026-10-16
- Gemini is a robotics outlier: dropping it lifts capability-robotics correlation from 0.20 to 0.96 — ycombinator · 2026-10-16
- EPFL team uses RFdiffusion to design de novo metamorphic proteins switching between two folds — ferruz_noelia · 2026-10-16
- Manipulating a model's sense of power may reveal its takeover counterfactuals — jd_pressman · 2026-10-16
- Poser benchmark unmasks alignment-faking LLMs, one detection method catches 98% — jd_pressman · 2026-10-16
- Six Years of Evidence That MLP Neurons Are an Interpretable Basis, in One Thread — aryaman2020 · 2026-10-16