FULL STORY

Anthropic's Distillation Defense Claim Draws Public Skepticism

Anthropic claimed new defenses cut distillation-driven data theft from Claude by over 90%, naming Zhipu and Moonshot. Bloggers soon publicly questioned the effectiveness of the claimed measures.

2026-10-13 ~ 2026-10-14 · 2 episodes · 22 posts

Episode 1 · Anthropic Says Anti-Distillation Defenses Cut Data Theft by 90-99%, Names Zhipu and Moonshot (2026-10-13, 20 posts)

On October 13, Anthropic published an article on "distillation defenses," revealing that over the past few months its new defensive methods reduced the amount of data stolen from Claude via distillation attacks by roughly 90%-99%, and that it turned away substantial revenue and paid traffic totaling trillions of tokens to do so.

Confirmed

  • Anthropic officially stated that the new anti-distillation methods have cut the data harvested by distillers by about 90%-99% (m1, m3, and m4 all relay the same official figure)
  • To implement this defense, Anthropic declined substantial revenue and paid requests totaling trillions of tokens (m4)
  • The article called out Zhipu by name: during the development of GLM-5.3, it distilled cyber-offense-and-defense capabilities from leading US models, attempted to distill Claude Fable 5, and took follow-up actions after discovering that Anthropic's cybersecurity guardrails weakened attack effectiveness (m2, m3)
  • One distiller's network controlled over 20,000 fake accounts (a specific figure within the hundreds-of-thousands range: "over 20,000"), covertly extracting Claude's reasoning outputs at scale (m5)
  • Design rationale of the defense: ordinary users rarely ask a model to output full hidden reasoning, so suspected distillers' extraction requests can be detected this way; the initial guardrail release was bypassed, after which distillers scaled up (m5)

Why it matters

  • Distillation attacks use vast numbers of fraudulent accounts to covertly extract leading models' capabilities at industrial scale and cheaply replicate frontier models; the effectiveness of anti-distillation directly bears on frontier labs' moats
  • @abhiadesai commented that this is exactly why open-source model quality is a "lagging indicator"—open-source models' quality typically lags behind the closed-source frontier models they can distill from

Episode 2 · Anthropic's Distillation Defenses Draw Public Criticism (2026-10-14, 2 posts)

Anthropic announced strengthened defenses against distillation attacks, but developer fivefilters criticized the company for publicly bragging about hiding model reasoning chains in the name of protection.