OpenResearch Intelligence Index: first open benchmark for end-to-end autoresearch

BenBlaiszik · x · 2026-11-21

alphaxiv launched the OpenResearch Intelligence Index, billed as the world's first open-source benchmark for end-to-end autoresearch, asking which models are best for RSI, literature understanding, and running real experiments.

They spent $7.4k in tokens across 8 models, 6 providers and 3 evaluation tracks: scientific knowledge (20 hand-picked Terminal-Bench-Science tasks), post-training ability (6 novel post-training tasks), and literature relevancy/taste (a PaperFindingBench subset). Each model runs in its native harness inside OpenResearch. The index so far includes Opus 5.

Related event: alphaXiv and Together AI Launch First Open Benchmark for Autonomous Research(2 posts)→

Original post →

More from coding & agent

coding & agent channel →