Do LLM Jailbreak Tests Rely on Special Access?

npinto · x · 2026-07-10

Researcher Owain Evans points out that when publishing research on LLM jailbreaks, authors should clarify whether they used "special access" to obtain the model's chain of thought and classifier labels during testing. This is crucial for evaluating the versatility of the jailbreak method and its actual threat level in real-world scenarios.

Related event: New Insights into LLM Jailbreak Testing and Safety(3 posts)→

Original post →

More from Safety

Safety channel →