AAAI 2027 review debate: Should empirical papers without code be auto-rejected?
SimpleObvious4048 · reddit · 2026-08-25
An AAAI 2027 reviewer received four empirical papers, none providing code or data despite conference rules requiring it for reproducibility. While missing code isn't universally an auto-reject due to IP or funding constraints, unverified empirical claims significantly lower confidence scores. The reviewer plans to request anonymized code in the rebuttal, sparking a discussion on whether reproducibility should be a hard rejection criterion.
More from Research
- EMNLP 2026 Accepts 5,252 Papers: Over 2,700 in Main Conference — delliott · 2026-08-25
- Paper: Are Pathology Foundation Model Latent Representations Invariant to Rotation? — iScienceLuvr · 2026-08-25
- Researcher calls for 2026 update to key paper, eyeing pathology domain — iScienceLuvr · 2026-08-25
- Author shares personal workflow for benchmarking models — 0xsachi · 2026-08-25
- EgoStandard: Egocentric Video Dataset Trends on Hugging Face — LightwheelAI · 2026-08-25
- Microsoft Open Sources Thinkingbox: Stateful Agent Workflow Benchmark — microsoft · 2026-08-25