Scholars Call for Code and Data in Peer Review, Saying Methods Text Can't Be Trusted
RexDouglass · x · 2026-11-12
Megan T. Stevenson makes a radical proposal: journal editors should require authors to submit their code and even data along with papers, since written descriptions of research methods are often highly inaccurate—only code and data make verification possible. Rex Douglass agreed, quipping that the idea that "natural language is what matters, while code and data are unimportant" is laughable. A discussion about the culture of academic reproducibility.
More from Research
- Chronicle Bio announces first clinical trial with Prolong, using AI to match patients for ME/CFS drug — thekaransinghal · 2026-11-13
- Salesforce's A²-Bench: 500 scenarios expose 20 failure modes in multi-agent teamwork — mohitban47 · 2026-11-13
- Matrix optimizers likely within 5-10% CE of each other, researcher argues — _arohan_ · 2026-11-13
- Princeton/Stanford study: optimizer rankings reverse as batch size changes — _arohan_ · 2026-11-13
- Matteo Pasquinelli's four theses on AI's place in the history of technoscience — ArtificialOther · 2026-11-13
- Chrome team cuts coding-agent vector search from 507 MB to a 7-line loop at 30µs — gaganghotra_ · 2026-11-13