The hidden tax of multimodal AI: lung cancer study questions cross-validation gains
bravo_abad · x · 2026-09-14
Multimodal AI sounds automatically better in medicine, but every added modality costs: fewer patients have complete data and measurements are harder to keep consistent across sites.
The I³LUNG study makes the trade-off visible:
- Of 2,396 lung cancer patients, only 339 had all four modalities.
- In cross-validation, adding pathology and imaging raised AUC from 0.68 to 0.88 on a 24-month survival task.
- But those gains failed to consistently survive independent test and external validation, even for a fusion model designed to handle missing modalities.
Takeaway: multimodal AI carries a hidden tax of data completeness and poor external generalization; cross-validation results can be misleading.
More from AGI Musings
- Ethan Mollick on AI and work: 'You're a hand-weaver in a world of power looms' — emollick · 2026-10-30
- YC experiment: Claude agents formed democracies while GPT agents formed hives — soumitrashukla9 · 2026-10-30
- Vercel founder Rauch: trust is the deepest moat for a post-AGI business — soleio · 2026-10-30
- Scattered Across AI Assistants: A New Kind of Cognitive Failure Nobody Has a Prior For — manosaie · 2026-10-30
- a16z partners: 10-20M people drive $150-200B in token spend, and AI workspaces will eat the browser — petergyang · 2026-10-30
- Professor Who Turned Down OpenAI in 2018 Reflects on PhD Anxiety in the AI Era — SharonYixuanLi · 2026-10-30