AI can automate robustness checks on papers to detect selective reporting
paulnovosad · x · 2026-08-31
The author suggests that with AI, it is now possible to back out the complete set of possible robustness checks for any paper and infer whether results were selected or chosen randomly. This could address the issue of authors having excessive degrees of freedom in peer review processes.
More from Research
- Language models will revolutionize controllable world building in Houdini, Blender, and Unreal — bilawalsidhu · 2026-08-31
- Sub-2-minute training enables aggressive hyperparameter search and rapid experimentation — yacineMTB · 2026-08-31
- Deliverome Launches at Astera Institute to Target Drug Delivery Problem — iskander · 2026-08-31
- Hedgonomy detects code hallucinations via environment verification, not other AI — lovettsendit · 2026-08-31
- Rerunning LLM eval 290 times shows single-pass comparisons are just luck — ActiveStriking2719 · 2026-08-31
- DeepTMHMM2: Open-source tool for transmembrane protein topology prediction — AllThingsApx · 2026-08-31