Ablation Tests Reveal Training Data Gaps in Sitcoms and Movies
altryne · x · 2026-08-29
Developer Altryne ran ablation tests on Friday night to check if various sitcoms, TV shows, and movies were included in the training data. The results indicated that the show 'Community' was apparently not trained on. The experiments utilized credits from the fal platform to explore knowledge gaps in the model.
More from Research
- VideoGen-Agent: An 8B Multimodal Agent Turns Video Generation Into a Tool-Use Loop — jiqizhixin · 2026-10-16
- Comprehension Audits: New Paper Proposes a Gate for AI-Written Code at Frontier Labs — ronbodkin · 2026-10-16
- Nature paper uses language models to map single neurons behind human language — raphaelmilliere · 2026-10-16
- Reviewer shares workflow: feeding the finished review — never the paper — to AI for a second pass — StingMeleoron · 2026-10-16
- 3SUM record falls to O(n^1.921), Lean-verified — but will it yield usable algorithms? — iskander · 2026-10-16
- Ablation studies to help Kaggle Gemma 4 competition participants — ayushthakur0 · 2026-10-16