Alibaba's ClinFusion: 8B Medical VLM Beats Gemini 3 Flash on Most Benchmarks

jiqizhixin · x · 2026-08-29

Medical VLMs face a dilemma: 2D-centric models lose 3D structure while 3D-centric ones need expensive alignment, and existing benchmarks don't measure what clinicians care about. Alibaba DAMO Academy's ClinFusion (8B and 32B) tackles both.

Its core is CaSL Fusion, a local cross-attention that fuses 2D and 3D features without increasing visual tokens sent to the LLM — raising per-token information density while cutting compute from quadratic to linear. It also introduces a clinically aligned, factuality-oriented evaluation framework.

Results: first or second on all eight 2D VQA benchmarks, with the 8B beating Gemini-3-Flash on most; on abdominal CT QA it outperforms the strongest open-source same-size model by 14.5 points.

Original post →

More from Multimodal

Multimodal channel →