Apodex Launches TRACES, First Benchmark for Evaluating 'Discoverative AI' on Real-World Problems
Faheem_uh · x · 2026-09-11
Apodex released Apodex Discovery, a new benchmark paradigm for 'discoverative AI' — targeting real-world problems with no ground truth answers. Key points:
- TRACES is the first published standard evaluating the likelihood of defensible discovery when the answer is unknown.
- The evaluation unit is the complete solver: model, tools, memory, and workflow together.
- Built from fieldwork by 10 STEM PhDs scouting 561 industries across 16 sectors, yielding a registry of 423 real-world problems; 20 are live as executable environments (AAV gene-delivery design, drug repurposing, clinical trials, LLM engineering).
- Problem and solver submissions are open; paper is on Hugging Face.
Related event: Apodex unveils TRACES benchmark for discovery-oriented AI(3 posts)→
More from Research
- Just Action Model: decoupling what separates VLA from world-action models — Yonghao Yu · 2026-10-28
- HABIT-Bench: Best agent memory system scores just 33.61% at inferring user habits — SJTU · 2026-10-28
- CodeCap-Bench: executable code beats natural language as video captions — Jiafu Tang · 2026-10-28
- Omni-InteractScope benchmarks proactive interaction in continuous omnimodal streams — Qwen · 2026-10-28
- Mistral releases Timestral time-series foundation models, tops GIFT-Eval — mistralai · 2026-10-28
- NVIDIA's ThinkWorld learns robot skills from unlabeled human videos via chain-of-dynamics reasoning — nvidia · 2026-10-28