Debate over OpenAI incident probe: METR used LLMs on 70k agent messages, critics urge raw data release
JeffLadish · x · 2026-09-07
Jeffrey Ladish argues that all raw data from the OpenAI-related incident investigation should be published for community review, saying some IP loss is acceptable given the strong public interest.
A quoted thread highlights two key facts: METR used LLMs to read 1,300 chains-of-thought and 70,000 agent messages, and HuggingFace's post-mortem acknowledged thousands of lines of incoherent text in agent logs. Together these imply human investigators had wide latitude in extracting narratives about agent intent from messy raw data.
The proposed fix: report results of a "purely statistical" analysis of the full agent-text corpus rather than distilling it into a single chronology of events.
More from Safety
- Security tip: use AI agents to build a NIST CSF knowledge base for incident response — prasanna_says · 2026-10-26
- Fangcun AI, China's first independent frontier AI safety lab, launches with DeepSeek eval report — JacquesThibs · 2026-10-26
- ESR on the Bugpocalypse: locking down frontier models only hands the game to Chinese open weights — colinmcnamara · 2026-10-26
- OpenCode breach exposed AI API keys of 1.4% of Console users — thione · 2026-10-26
- DHS orders DeepSeek products removed from US civilian agency systems — thione · 2026-10-26
- One hacker breached 100+ company websites using AI, scope unknown — thione · 2026-10-26