Only 28.4% of papers fully reproducible from raw data, replication study finds
RexDouglass · x · 2026-09-26
- The I4Replication project shows reproducibility depends heavily on the starting point:
- From authors' final analysis data: 58.2% fully reproducible, 32.8% partially, 9.0% not.
- From raw data: only 28.4% fully reproducible, 34.3% partially, and 37.3% not reproducible at all.
More from Research
- Biopharma Bench: agents complete only 8 of 71 real biopharma tasks, GPT-6 Astra leads — AllThingsApx · 2026-09-26
- Matryoshka Attribution finds neural network circuits via gradient descent, tops interpretability benchmark by 2.9x — stanfordnlp · 2026-09-26
- Anthropic's science blog shows Claude pulling off 'Nine Loops' particle physics calculations — rohanpaul_ai · 2026-09-26
- UniReps workshop invites NeurIPS rejects, deadline Oct 4 for Paris event — Pseudomanifold · 2026-09-26
- Creative Destruction Lab opens 15-year tech startup panel dataset to researchers — avicgoldfarb · 2026-09-26
- Building the next OCR benchmark: skalskip92 seeks hard samples from handwriting to technical drawings — BLUECOW009 · 2026-09-26