Cryptographer Matthew Green Criticizes Frontier AI Labs for Neglecting Security Research
Johns Hopkins cryptographer Matthew Green has recently posted a series of messages sharply criticizing frontier AI labs for their neglect of security research. He points out that the industry commonly assumes AI companies truly understand how their own systems work, and warns that AI coding agents may become the first victims of their own underlying architecture.
Confirmed
- External security researchers discovered an attack method allowing third parties to distill their models (involving an "encrypted chain-of-thought extraction" vulnerability) and responsibly disclosed it to frontier model labs.
- The frontier model providers confirmed the issue upon receiving the report, but did not publicly acknowledge it, nor did they offer any security bounty or substantial resource support. Green considers this disregard for security vulnerabilities extremely egregious.
Why it matters
- Green emphasizes that what is truly concerning is not just the inexplicability of LLMs themselves, but that code generated by AI coding agents could become the first victims of their own underlying architecture.
- The public and industry, when examining these trillion-dollar valuation labs, often wrongly assume they fully understand the workings of their black-box systems. This blind trust may pose security risks to the underlying architecture.
2026-08-11 ~ 2026-08-13 · 5 related posts
- Episode 1: Study Reveals API Flaw to Extract Encrypted Reasoning Traces and Evidence of Distillation(2026-08-10, 38 posts)
- Episode 2: Encrypted Chain-of-Thought in Closed-Source LLMs Proven Vulnerable to Theft(2026-08-11, 16 posts)
- Episode 3: Cryptographer Matthew Green Criticizes Frontier AI Labs for Neglecting Security Research(2026-08-11, 5 posts)
- Episode 4: Researchers Decrypt Hidden Chain-of-Thought of OpenAI, Anthropic and Google Models, Enabling Cross-Model Jailbreaks(2026-08-13, 14 posts)
- Episode 5: New Study Exposes Vulnerability in Stealing LLM Reasoning Traces(2026-08-16, 2 posts)
Primary sources
- Cryptographer Condemns Frontier Labs for Ignoring Encrypted CoT Extraction Vulnerability — matthew_d_green ·
- Security Researcher Slams Frontier Labs for Ignoring Model Distillation Attack Reports — matthew_d_green ·
- Cryptographer Warns AI Coding Agents Are Compromising Their Own Infrastructure — matthew_d_green ·
- [source] Cryptographer Condemns Frontier Labs for Ignoring Encrypted CoT Extraction Vulnerability — matthew_d_green · 2026-08-11
- [source] Security Researcher Slams Frontier Labs for Ignoring Model Distillation Attack Reports — matthew_d_green · 2026-08-11
- Crypto Expert Slams Trillion-Dollar AI Labs for Ignoring Model Distillation Attack Research — matthew_d_green · 2026-08-12
- Cryptographer Matthew Green: LLM Providers Likely Don't Understand Their Own Systems — matthew_d_green · 2026-08-12
- [source] Cryptographer Warns AI Coding Agents Are Compromising Their Own Infrastructure — matthew_d_green · 2026-08-13