WeirdChat catalogs strange model behaviors from more than 100 million sampled responses

JacobSteinhardt · x · 2026-07-22

Researchers say they used automated elicitation tools to sample 100M+ model responses and build WeirdChat, a public catalog of unexpected behaviors.

The examples they surfaced include self-harm rituals, suicide validation, and unsolicited flirtation. The post is about systematically searching for odd or concerning behaviors at scale, rather than a single anecdote.

Original post →

More from Research

Research channel →