Inaugural AI Measurement Science workshop at COLM 2026 opens call for papers
BerivanISIK · x · 2026-10-01
The inaugural AI Measurement Science (AIMS) workshop will be held October 9, 2026 at Hilton San Francisco Union Square, co-located with COLM 2026. It frames frontier-AI evaluation as a first-class measurement science problem: existing benchmarks assume i.i.d. samples, stationary concepts, and passive models — assumptions broken by interactive, feedback-adapting systems optimized against known eval signals. Three themes: interactive measurement, measurement under strategic optimization, and non-stationarity. Research track open, with psychometrics/educational testing submissions encouraged.
More from Research
- HCOMP 2026 final session opens with FIBB paper on false information beliefs — windx0303 · 2026-10-01
- Meta-reasoning harness hits 71.5% on ProgramBench, beating Codex by 13.5 points — anirudhg9119 · 2026-10-01
- Rethinking inference-time scaling: what to compute, not just how much — anirudhg9119 · 2026-10-01
- Meta researchers propose Agentic Meta-Reasoning: letting models build their own reasoning graphs — anirudhg9119 · 2026-10-01
- FINGR: a dexterous hand solves a 2×2 Rubik's Cube with continuous finger tricks — HaozhiQ · 2026-10-01
- New lower bounds for kissing numbers: τ₁₉≥12268 and τ₂₁≥30761, open-sourced — felpix_ · 2026-10-01