Probe finds Claude Opus 5.5 memorized protein sequences; other LLMs show no such sign

anshulkundaje · x · 2026-11-18

Researchers released the LLM-bioseq-probe repo, testing via each model's API whether protein/DNA sequences were in training data. Key finding: Claude Fable 5.2 and Claude Opus 5.5 predict human and mouse coding sequence—but not the rest of the genome; they learned proteins, not genomes. No other model tested showed a clear sign.

The test asks models to complete the next amino acids of 668 bacterial/archaeal proteins from 167 "domain of unknown function" (DUF) Pfam families—little-studied, with no solved structures, almost no papers, and no UniProt sequence within 90% identity—so only training data could predict them. Each question is repeated with shuffled controls. Code, data, and full model replies are open-sourced.

Related event: New probe suggests latest Claude models were trained heavily on protein sequences(8 posts)→

Original post →

More from Research

Research channel →