Cross-modal steering vectors transfer zero-shot between text and image generation

benno_krojer · x · 2026-10-28

A new preprint by Benno Krojer and Donghao Zeng asks how multimodal unified multimodal models really are. They show that steering vectors learned in one modality transfer zero-shot to the other, in both directions (text ↔ image generation). Co-author Tamar Rott Shaham highlights this as evidence for shared causal directions — and a shared conceptual space — across modalities.

Related event: New preprint: cross-modal steering vectors transfer zero-shot between text and image generation(7 posts)→

Original post →

More from Models

Models channel →