Berliner study: existing user-simulator metrics catch only 5-6 of 10 injected failures

geoffwolfe · x · 2026-11-22

UCLA and Berkeley researchers (incl. Ion Stoica, Cho-Jui Hsieh) released "On Evaluating User Simulators for Interactive Agents," a meta-evaluation of the metrics used to judge user simulators.

Original post →

More from coding & agent

coding & agent channel →