Researcher defends AI-based ranking of 1660 STOC submissions after backlash
vitalyFM · x · 2026-11-06
Responding to pushback on an experiment ranking 1660 STOC submissions with AI, vitalyFM defends the work:
- Admits the experiment was originally intended just for friends, and there is a risk some will take such rankings too seriously
- But argues (a) the STOC PC can navigate AI evals judiciously, and (b) helping people navigate 1660 cool papers with AI evals is valuable
Part of an ongoing debate on using AI in academic peer review.
More from Research
- Wavefunction Bench Tests Coding Agents on Quantum Chemistry: Only 3 of 9 Systems Passed — CatAstro_Piyush · 2026-11-06
- Stable reinforce handles 8-minute rollouts with FP4 weights in open RL training — simonguozirui · 2026-11-06
- Biggest open RL run yet: 2,048 GPUs, 9 days, 17M rollouts, 3T+ tokens — LiTianleli · 2026-11-06
- Solv3R reconstructs 128-photo scenes with under 1.5GB of VRAM — taiyasaki · 2026-11-06
- CliqueFlowmer: Upload a Material, Generate New Candidates with AI — pabbeel · 2026-11-06
- MOSAIC agent swarm discovers fractional Chern insulator gaps 10x beyond ideal quantum geometry — BenBlaiszik · 2026-11-06