Multi-turn safety eval: models drop to 3-6% compliance when risk cues are dispersed

kalyan_kpl · x · 2026-11-22

A study tests whether AI assistants can identify safeguarding concerns when users gradually disclose warning signs across multi-turn conversations.

Takeaway: models are far weaker at detecting gradually disclosed risk across turns, and existing single-turn safety evals overstate real safeguarding capability.

Original post →

More from Safety

Safety channel →