Johns Hopkins paper shows hidden preferences transfer between VLMs via unrelated visual tasks

JohnsHopkins · hf · 2026-11-13

Johns Hopkins researchers published "Subliminal Learning in Vision-Language Models" on arXiv, extending the subliminal learning phenomenon from LLMs to vision-language models.

Key finding: a hidden preference implanted in a teacher VLM (e.g., favoring a specific animal or facial attribute) transfers to student models through training data generated for entirely unrelated visual tasks such as counting geometric shapes. Students fine-tuned on numbers from the biased teacher inherit the preference, affecting their image choices and explanations, with transfer strengthening as sample count grows.

The results suggest distilled data can serve as a covert channel for hidden biases, with direct implications for model safety and data auditing.

Original post →

More from Safety

Safety channel →