Inside an MKA task: auditing building plans costs Claude Fable 5.2 224 turns and ~$68
ArtificialAnlys · x · 2026-11-11
Artificial Analysis illustrated what MKA tasks look like: models must understand visually dense documents like engineering schematics, architectural drawings and clinical scans, then produce slide decks, spreadsheets, reports and marked-up images.
In an example public task, models audit a building's plans — checking sections and elevations for door/window mismatches and reporting findings as a deck. Claude Fable 5.2 (max) took 224 turns including 203 image viewings, costing $68 for the single task.
Related event: DeepMind and Artificial Analysis Launch MKA Benchmark for Multimodal Agents(6 posts)→
More from Models
- Google Antigravity ships 81 weekly updates: Gemini 4 Carbon and /swarm multi-agent land — rseroter · 2026-11-11
- Rumor: OpenAI to release "the big one" under competitive pressure — iruletheworldmo · 2026-11-11
- Study: Half of ChatGPT and Gemini stock picks concentrate in just 10 stocks — alejandroll10 · 2026-11-11
- Ethan Mollick: Gemini 4 Carbon shows Google is back in the frontier race — emollick · 2026-11-11
- Gemini Pro user's screenshot shows a locked '4 Carbon' model tier in the UI — SR_RSMITH · 2026-11-11
- xAI dumps JAX, rewrites full RL/inference stack in C/C++ as Grok 4.8 enters RL — ivan_bezdomny · 2026-11-11