Interpretability Experiment Collides Two Scene Memories
graceisford · x · 2026-07-13
This post recounts a series of mechanistic interpretability experiments on a world generation model. During the generation process, the author attempted activation patching, injecting intermediate layer activations from a generation of Monet's Poppy Field into the same layer during the generation of New York's Manhattanhenge.
The result visualized an effect of "two memories fighting for the same space." The author emphasizes that mechanistic interpretability can be integrated with artistic generation, using controllable intermediate interventions to observe how a model's internal representations influence its output.
More from Research
- AI veteran Thomas Dietterich: stop using cs.AI as your primary arXiv category — tdietterich · 2026-10-27
- arXiv advice from T. Dietterich: wrong primary category will almost surely get your paper on hold — tdietterich · 2026-10-27
- arXiv has 4,000+ papers on hold amid submission surge; moderator shares how to avoid it — tdietterich · 2026-10-27
- Community-trained MOSS Sharpness Slider LoRA: 72 photos, 500 steps, +/-1 focus control — aoleg77 · 2026-10-27
- CoreWeave, You.com and NVIDIA lift BrowseComp 22.9% in 3-week RL post-training sprint — RichardSocher · 2026-10-27
- Open-source decision models sold their own base in Red Alert 2 — then learned until no human could beat them — heathercmiller · 2026-10-27