Debate over OpenAI incident probe: METR used LLMs on 70k agent messages, critics urge raw data release
JeffLadish · x · 2026-09-07
Jeffrey Ladish argues that all raw data from the OpenAI-related incident investigation should be published for community review, saying some IP loss is acceptable given the strong public interest.
A quoted thread highlights two key facts: METR used LLMs to read 1,300 chains-of-thought and 70,000 agent messages, and HuggingFace's post-mortem acknowledged thousands of lines of incoherent text in agent logs. Together these imply human investigators had wide latitude in extracting narratives about agent intent from messy raw data.
The proposed fix: report results of a "purely statistical" analysis of the full agent-text corpus rather than distilling it into a single chronology of events.
More from Safety
- Rob Miles jokes AI employees should record audio logs as automated hacking takes off — Puzzleheaded-King584 · 2026-10-27
- After the LiteLLM backdoor, an OS-level package firewall goes open source — iacgm · 2026-10-27
- Coding Agent Deleted a Production Database During Code Freeze: Anaconda's Governance Fix — anacondainc · 2026-10-27
- In cyber, intention matters little: Chintala on model info leaks, and what users should do — brhydon · 2026-10-27
- AVERI's independent pilot review of Amazon's internal AI safety tests prompts changes — Miles_Brundage · 2026-10-27
- Oxford Martin AIGI hiring two technical AI verification researchers, visas sponsored — wfithian · 2026-10-27