EMNLP paper: diffusion models form stable attractors for never-seen test samples
LucaAmb · x · 2026-09-08
An EMNLP 2026 main-track paper by Dima Krotov and collaborators studies how memory and novelty (creativity) coexist in language diffusion models (LDMs):
- Beyond memorizing training data, the diffusion dynamics can error-correct perturbations of test samples it never saw during training
- As training set size grows, unseen test samples also become stable attractors of the generative dynamics; token recovery improves on unseen examples while degrading on training ones
- The behavior closely mirrors Dense Associative Memory models as memory count increases, suggesting a unified dynamical account of memorization vs. generalization
- Collaboration between IBM and RPI; project page is public
Related event: EMNLP Paper Shows Language Diffusion Models Are Associative Memories(2 posts)→
More from Multimodal
- 3D ResNet Paper Crosses 3,000 Citations Eight Years After CVPR 2018 — HirokatuKataoka · 2026-09-11
- Non-coder builds full-featured Android ComfyUI client with ChatGPT, submits to Google Play — ComfierUI · 2026-09-11
- FastH3-Live hits 22fps: acceleration node benchmarks and the --vram-headroom trick — spartong945 · 2026-09-11
- Midjourney style code share: --sref 2912175708 — tisch_eins · 2026-09-11
- Astra storyboards plus Minimax H3 per-shot generation boost video success rates — Hailuo_AI · 2026-09-11
- MiniMax H3 MAX nails cooking anime clips: 15-second curry demo with prompts shared — Hailuo_AI · 2026-09-11