sokrypton: covariation in data underlies both LLMs and AlphaFold-style breakthroughs

sokrypton · x · 2026-11-04

sokrypton argues that covariation patterns in data made LLMs (text, code) and PLMs/AlphaFold possible — progress in other modalities will require collecting equivalent data, under natural or artificial selection, from which covariation can be extracted.

Related event: ESMFold author proposes tree-of-life ligand survey to replicate AlphaFold success for small molecules(8 posts)→

Original post →

More from Research

• 2-person lab Linum trains 2B text-to-image model from scratch for just $21K, Apache 2.0 — ycombinator · 2026-11-05
• Trained an MoE across two GPU clusters 25 Gbps apart — the compute islands guide — _arohan_ · 2026-11-05
• AutoDNA: AI agents run multi-step molecular biology experiments with minimal human input — james_y_zou · 2026-11-05
• The Stacks Project, algebraic geometry's giant reference, is now formalized in Lean — LinusEkenstam · 2026-11-05
• Perceptron Egocentric 1.0 turns egocentric video into robot training data at $29/hour — rohanpaul_ai · 2026-11-05
• Study benchmarks divergent creativity of LLMs against 100,000 humans in Scientific Reports — korymath · 2026-11-05

Research channel →