Contrastive World Models: latent-space world models beat pixel reconstruction under distractors
bonniesjli · x · 2026-09-26
bonniesjli presents Contrastive World Models: train latent states to maximize mutual information with future observations via Deep InfoMax, dropping pixel reconstruction entirely. In small-scale experiments CWM matches pixel-reconstruction and momentum-prediction baselines by default, and substantially outperforms both when distractors or natural video backgrounds are added, while training more efficiently without a decoder.
Related event: Contrastive World Models: Pure Latent-Space Training Beats Dreamer(5 posts)→
More from Research
- AlphaGenome 2: trained on 100M+ profiles across 68 tissues, 2x mutation detection — GoogleDeepMind · 2026-11-11
- AlphaGenome 2 adapts to lab data on the fly with just a few dozen cells — GoogleDeepMind · 2026-11-11
- DeepMind launches AlphaGenome 2, spotting nearly 2x more gene-regulating mutations — GoogleDeepMind · 2026-11-11
- Active learning with weak supervision cuts surgical video annotation effort by ~50% — Laparoscopes · 2026-11-11
- Tuva Labs takes 1st on ARC-AGI-2, 2nd on ARC-AGI-3 in ARC Prize 2026 — GregKamradt · 2026-11-11
- Sakana AI × Pathway Post-Transformers lecture on AI and the brain now online — kaixhin · 2026-11-11