Stanford HAI warns that averaging expert safety scores can erase good chatbot advice
StanfordHAI · x · 2026-07-25
Stanford HAI says AI developers often rely on mental health experts to judge whether chatbot answers are safe — but averaging expert scores can produce advice nobody would actually call good.
- The problem is not just disagreement, but the way disagreement gets collapsed into one number.
- The post points to a failure mode in safety evaluation for mental-health-style chatbot responses.
- It suggests that naive aggregation can hide meaningful differences in expert judgment.
More from Research
- New review: how prefrontal cortex dynamics turn world models into flexible behavior — AnnaCiaunica · 2026-10-27
- LIBERO-MAX: Robot Policies Drop 11–26 Points When the World Changes Mid-Task — drmapavone · 2026-10-27
- Kolab Benchmark Uses Pro Screen Recordings to Show AI Agents Overestimate Collaboration Quality — minnesotanlp · 2026-10-27
- One BBQ Example Pushes LLM Fairness Scores Past 90%, EMNLP Paper Questions Benchmarks — radamihalcea · 2026-10-27
- Real2Sem2Real turns one phone video into 2,000+ robot demos, matching 150 teleop demos — Scobleizer · 2026-10-27
- Understanding MuonH (Hyperball) through weight norm geometry of scale-invariant networks — jasondeanlee · 2026-10-27