First AI Measurement Science workshop at COLM 2026 targets rigorous AI evaluation
sanmikoyejo · x · 2026-10-11
Stanford's AIMS lab is hosting the inaugural AI Measurement Science workshop co-located with COLM 2026 (Oct 9, Hilton SF), uniting ML, statistics, psychometrics, economics, and policy researchers. It frames evaluation as a first-class scientific problem around three coupled challenges: measuring interactive systems, measurement under strategic optimization (benchmark gaming), and non-stationarity. Two submission tracks, cross-disciplinary submissions encouraged.
More from Research
- Toronto surgeons train AI to flag safe incision zones in real time during surgery — EricTopol · 2026-10-11
- Mathematician digests OpenAI's number theory results; Hodge papers pulled over sign error — lpachter · 2026-10-11
- SpIDER paper boosts code retrieval for coding agents via semantic search plus code graphs — mangahomanga · 2026-10-11
- CMU professor builds detailed 3D dragon from 27KB of code via Astra — 141_1337 · 2026-10-11
- Claude surfaces hidden planetary system 158 light-years away from public telescope data — DavidmComfort · 2026-10-11
- Diffusion LM Best-Paper Author Dropped Out of Stanford PhD to Join OpenAI — aaron_lou · 2026-10-11