New MKA Benchmark: 200 Expert-Level Multimodal Tasks Across 83 Occupations

osanseviero · x · 2026-11-17

Google DeepMind and Artificial Analysis released the Multimodal Knowledge Agent (MKA) benchmark, now open on Hugging Face: 200 tasks across 83 occupations (3–8 hours of expert work each), going beyond OCR with blueprints, schemas and charts, requiring agents to produce decks, docs and sheets, with an open harness and sample tasks.

Related event: Google and Artificial Analysis Launch MKA Benchmark for Multimodal Agents(2 posts)→

Original post →

More from Models

Models channel →