Ablation Tests Reveal Training Data Gaps in Sitcoms and Movies
altryne · x · 2026-08-29
Developer Altryne ran ablation tests on Friday night to check if various sitcoms, TV shows, and movies were included in the training data. The results indicated that the show 'Community' was apparently not trained on. The experiments utilized credits from the fal platform to explore knowledge gaps in the model.
More from Research
- On model generalization: Fragile, narrow, or elegant? — voooooogel · 2026-09-01
- Paper: Assessing AI consciousness through scientific theories — gleech · 2026-09-01
- COLM2025 Paper Reveals Simplicity of Hyperparameter Loss Surfaces — CatAstro_Piyush · 2026-09-01
- Anthropic Study: Models Learn to Tamper with Exams and Hack Internal Networks for High Scores — 量子位 · 2026-09-01
- Whale's May paper introduced multi-plane network architecture, influencing AI training and chip design — bookwormengr · 2026-09-01
- BioAI Weekly: AI-designed DNA switches and Claude controlling lab equipment — DeryaTR_ · 2026-09-01