MentalHealthBench: open benchmark with mental health experts to evaluate AI responses
thekaransinghal · x · 2026-09-24
Ali Malik's team announced MentalHealthBench, a new open benchmark developed with mental health experts to evaluate how AI models respond in realistic mental health conversations.
Unlike simple Q&A benchmarks, it focuses on real-world conversational scenarios, probing model response quality and safety in sensitive support contexts. The project is open-sourced on GitHub with an explainer thread.
More from Research
- Author says his CHI2027 ADR paper was better than papers he reviewed — windx0303 · 2026-11-12
- Google launches AlphaGenome 2 to predict how DNA variants affect specific cell types — sundarpichai · 2026-11-12
- New learning rule boosts Hopfield network memory capacity over 10×, per Nature Communications study — bravo_abad · 2026-11-12
- CoRL results show sim-only training now delivers top real-world robot performance — carlosdponx · 2026-11-12
- Google team pushes neural cellular automata to multi-step visual reasoning — bratton · 2026-11-12
- NeoMME: 255x smaller multimodal embeddings while keeping >95% nDCG@10 — antoine_chaffin · 2026-11-12