Alibaba's ClinFusion: 8B Medical VLM Beats Gemini 3 Flash on Most Benchmarks
jiqizhixin · x · 2026-08-29
Medical VLMs face a dilemma: 2D-centric models lose 3D structure while 3D-centric ones need expensive alignment, and existing benchmarks don't measure what clinicians care about. Alibaba DAMO Academy's ClinFusion (8B and 32B) tackles both.
Its core is CaSL Fusion, a local cross-attention that fuses 2D and 3D features without increasing visual tokens sent to the LLM — raising per-token information density while cutting compute from quadratic to linear. It also introduces a clinically aligned, factuality-oriented evaluation framework.
Results: first or second on all eight 2D VQA benchmarks, with the 8B beating Gemini-3-Flash on most; on abdominal CT QA it outperforms the strongest open-source same-size model by 14.5 points.
More from Multimodal
- The math: 5 rerolls at 480p plus a 4K upscale costs $5 vs $9 at 720p — HeyAmit_ · 2026-10-15
- Dreamina workflow: generate at 480p, upscale to 4K, cut video costs 44% — HeyAmit_ · 2026-10-15
- One-prompt GPT-6 Astra writes two Palestrina-style motets in LilyPond — deanwball · 2026-10-15
- DiffSynth-Studio Adds OPD Workflow: Few-Step Diffusion Training in ~2 GPU-Hours — bdsqlsz · 2026-10-15
- AI film and TV hit the market: Prime Video picks up AI spin-off, pilots screen at Mipcom — lmoroney · 2026-10-15
- Ramayana film taps DNEG's massive VFX and AI-assisted production for global release — CurieuxExplorer · 2026-10-15