Lior and Stanford launch $100K MMBU Challenge to test if biomedical AI really sees
LiorOnAI · x · 2026-10-01
Lior On AI is teaming up with Stanford to launch the MMBU (Massive Multimodal Biomedical Understanding) Challenge, targeting a core weakness of multimodal models: they often answer biomedical questions convincingly without actually understanding the image, failing to identify basics like imaging modality, body part, specimen, or stain.
- 3 tracks, $100K+ in compute and prizes
- Runs Oct 1 to Dec 31, registration closing
- Backed by Anthropic, Stanford AI Lab, biohub and others
Related event: Stanford and Partners Launch $100K MMBU Biomedical Multimodal Challenge(3 posts)→
More from Models
- 19 fixtures, 6 models, 3 runs: newest AI models didn't beat the old one at finding bugs — ChanceKelch · 2026-10-01
- Kilpatrick: Gemini 4 Argon is 'just the start' of Google's model progress — OfficialLoganK · 2026-10-01
- Google launches Gemini 4 Argon with 1M-token output, $2/$10 intro pricing — _philschmid · 2026-10-01
- Google previews Gemini 4 Argon benchmarks, rolls out to cyber defenders first — ammaar · 2026-10-01
- Gemini 4 Argon ships with industry-leading 1M token output limit, frontier long-horizon reasoning — GoogleAI · 2026-10-01
- Gemini 4 Argon said to hit SoTA, with claims of saving 300TB memory in data centers — thesaraharminta · 2026-10-01