JHU study finds in-context learning emerges across language, genome, protein and image models alike
DanielKhashabi · x · 2026-09-16
New research from JHU CLSP, "Convergent Emergence of In-Context Learning Across Modalities," shows that models trained on language, genome, protein, image, timeseries, and integer sequences all exhibit few-shot in-context learning.
Notably, their ICL performance is highly correlated across modalities, suggesting ICL is a convergent emergent phenomenon rather than something unique to language models.
Related event: JHU Study: In-Context Learning Emerges Across Modalities(2 posts)→
More from Research
- Sora's Diffusion Transformer explained by hand in 14 steps: prompts enter only as scale and shift — ProfTomYeh · 2026-09-16
- Researcher: any agent acting over long horizons provably has a self-model and world model — chris_j_paxton · 2026-09-16
- Ben Antieau guest post on Terence Tao's blog: mathematics needs both 'fast math' and 'slow math' in the LLM era — littmath · 2026-09-16
- VisTW: a Traditional Chinese VLM benchmark for reading Taiwan — and an eval framework that caught a 36-point bug — piske_usagi · 2026-09-16
- Mind2Dialogue Simulates User Mental States to Train Human-Aware LLMs — Zixuan Wang · 2026-09-16
- NUS Survey Maps Six Roles for Foundation Models Across the Game Lifecycle — NationalUniversityofSingapore · 2026-09-16