Tsinghua, MIT, Harvard launch ASI-Bench to measure AI's scientific autonomy
jiqizhixin · x · 2026-09-04
Tsinghua University, together with MIT, Harvard, CMU, USTC, Microsoft Research, and 10+ other institutions, has released ASI-Bench, the first benchmark designed to measure AI systems' scientific autonomy rather than recall of known knowledge. It evaluates whether AI can independently choose research questions, pick methods, decide what to observe, and self-correct when early steps fail—the combination of novelty and execution that defines real scientific discovery. The benchmark is open for community contributions.
More from Research
- Startup Electric Plant builds an AI model to decipher plants' electrical signals — TechCrunch AI · 2026-10-21
- Eval researcher teases guide to subjective-task evals, with a curated resource list — cwolferesearch · 2026-10-20
- IIT Madras article splits LLM memory into five approaches and asks why belief revision is still missing — LimeOptimal539 · 2026-10-20
- Scholar writes AI-assisted book on storytelling values, work nominated for EMNLP best paper — _akpiper · 2026-10-20
- Google's T2J-Bench shows coding agents score just 0.676 migrating PyTorch repos to JAX — CShorten30 · 2026-10-20
- New proof: perfect reconstruction can't guarantee VAE latent codes read back as written — Hidenori8Tanaka · 2026-10-20