Ex-OpenAI researcher questions red-teaming report: is 270 findings 'saturated'?

suchenzang · x · 2026-10-24

Suchenzang, former OpenAI applied research lead, shared OpenAI's red-teaming chart showing 280 deduplicated candidate findings over 350B tokens spent by red-teaming agents, with a sharp jump around 100B tokens before plateauing. She questions what qualifies as a unit of "a finding" and whether the curve truly indicates saturation. The chart's caption notes it reflects the scale and progress of the effort, not a controlled compute-vs-findings relationship.

Related event: Ex-OpenAI Researcher Questions Red Team Report Saturation and Canary String(2 posts)→

Original post →

More from Safety

Safety channel →