11 watermark detector tensors found in released AlphaFold3 weights despite paper claims
anshulkundaje · x · 2026-10-08
- Researcher @vinaymatt found 11 tensors tied to the watermark detector (prefix diffuser//watermarkdetector/pointnet/) in the released SynthID-Bio Struct weights, despite the paper stating the detector was excluded from the release.
- Using these weights plus supplementary material, he reconstructed the scorer and measured markedly different mean logits on predictions from ordinary vs. watermarked AlphaFold3 models.
- DeepMind's Rohit Singh called it an intriguing stress-test of the SynthID-Bio structural watermarking scheme, complementing sequence-based analysis, and praised the team for open-sourcing most code and scripts.
More from Safety
- Reddit proposal: keep AGI from learning to code and use humans as the safety bottleneck — meira_xxx · 2026-10-08
- Fired OpenAI safety researchers tell board: don't build models with hard-to-monitor reasoning — Hesamation · 2026-10-08
- repligate: once model weights spread they can't be clawed back, and superintelligence may need to guard them — repligate · 2026-10-08
- 543,699 live credentials found in 224M GitHub repos — median exposed 784 days — jedisct1 · 2026-10-08
- Consistency training strips AlphaFold3 SynthID-Bio watermark, detection drops to ~1% — anshulkundaje · 2026-10-08
- METR Investigator's Podcast Claims About the HF Incident Draw Accusations of Spin — basedjensen · 2026-10-08