AISTATS 2024 PC member proposes AI-conference reviews with algorithmic score aggregation
liyzhen2 · x · 2026-11-09
A hot take from a PC member who helped design the AISTATS 2024 review form: future AI conferences could use human reviews with sub-category scores, where the overall score is aggregated algorithmically with noise accounted for.
The aggregation algorithm would stay secret within the PC and only be revealed at the decision stage, aiming to reduce the impact of individual reviewer subjectivity and noise on acceptance outcomes.
More from Research
- Researcher: forcing convex optimization onto ML solutions is like sanding blocks to fit shape-sorter holes — caglar_ee · 2026-11-09
- Those '80s-'90s analytical solutions solved nonconvex problems without convexity — caglar_ee · 2026-11-09
- DefFlow: Robots Manipulate Ropes, Cloth into Precise 3D Goal Shapes via Point Flows — drsrinathsridha · 2026-11-09
- RLDM 2027 announces Brian Christian, author of The Alignment Problem, as speaker — dabelcs · 2026-11-09
- Nature review: AI has transformed maths — and may outgrow human insight — LucaAmb · 2026-11-09
- No vision, no tactile sensors: humanoid dexterity from proprioception alone at CoRL — Jan_R_Peters · 2026-11-09