AlphaFold3 MSA retraining probes whether it learns inverse covariance structure

anshulkundaje · x · 2026-07-22

Researchers retrained the MSA module of AlphaFold3 from scratch on an unsupervised objective to probe what it is learning.

• The goal is to test the claim that AlphaFold3 learns to invert the covariance matrix.
• The post says they essentially retrained just the MSA part and used the setup to see whether the model can recover unsupervised contact prediction behavior.
• The attached diagram shows the AlphaFold3-style MSA and pair representations, triangle updates, and the final unsupervised contact prediction head.

Original post →

More from Research

• Causal-only attention for non-generative tasks is wasteful, argues HF engineer — antoine_chaffin · 2026-09-11
• Catholic University of Chile researcher: scaling AI feedback is key to sustainable medical education — julianvarascom · 2026-09-11
• Nature paper images cellular activity across all organs, revealing body-wide circuits — arjunrajlab · 2026-09-11
• SignNet 1M Dataset Released for Sign Language Research — ducha_aiki · 2026-09-11
• ECCV26 Oral: Flow Matching Enables Single-Stage Multi-View Point Cloud Registration — ducha_aiki · 2026-09-11
• InFlux++ Method Released — ducha_aiki · 2026-09-11

Research channel →