Model collapse explained: what happens when AI trains on AI-written internet content
alifcoder · x · 2026-11-12
Andrew (@heyandrewai) walks through a key question for the next generation of AI: what happens when models learn from an internet increasingly filled with AI-written content? Models could end up training on copies of their own answers — a possible outcome researchers call "model collapse."
The accompanying graphic visualizes the degradation across generations G1 to G5. The thread's key point: collapse is not inevitable, and the thread explains why and how it can be mitigated.
More from AGI Musings
- SciMuse in PNAS: 100 Max Planck leaders grade 4,500 AI research ideas — MarioKrenn6240 · 2026-11-12
- chrisalbon: Show me 3 months and 1000 prompts, not one magic prompt — chrisalbon · 2026-11-12
- New-grad big tech engineer sums up the industry: "we made sand think" — var_epsilon · 2026-11-12
- Mistral AI philosopher Giada Pistilli to debate AI companions with UPC students — GiadaPistilli · 2026-11-12
- VC: 'Age of Miracles' beats doom talk as the more effective IPO marketing pitch — firstadopter · 2026-11-12
- Remote Labor Index paper on AI automating remote work: 'computer workers should buckle up' — FlorianGallwitz · 2026-11-12