MIT's ModaLens finds report availability sharply reduces medical VLM image sensitivity
MIT · hf · 2026-09-15
MIT released ModaLens on Hugging Face, a tool for measuring image sensitivity in report-conditioned medical VLMs.
A paired image-swap audit shows that when reports are available in radiology QA, VLMs become substantially less sensitive to image changes—suggesting overreliance on text over the actual imaging.
More from Research
- Lecture slides online: Reinforcement Learning for Autonomous Driving at ELLIS summer school — abursuc · 2026-09-15
- New arXiv paper invites mathematicians to tackle AI safety, field by field — stevenstrogatz · 2026-09-15
- Orthrus Study: Lossless Speculative Decoding Holds Only at High Numerical Precision — Ilya Koziev · 2026-09-15
- MIT team's Recursive Meta-Intelligence: AI builds its own instruments to crack metamaterials — ProfBuehlerMIT · 2026-09-15
- Ground Truth Is Rarely Ground Truth in AI for Science, Researcher Warns — bravo_abad · 2026-09-15
- Pitch: train a generative game model on RL agents playing millions of times, ship the weights — theteknosaur · 2026-09-15