MKA Benchmark: Gemini 4 Carbon Scores 54.3% at $5.63 Per Task vs Claude's $35.28
_philschmid · x · 2026-11-17
The Multimodal Knowledge Agent benchmark from Google and Artificial Analysis spans 200 multi-step tasks across 10 verticals built around CAD blueprints, RF schematics, GIS maps, gel plates and charts. Gemini 4 Carbon scores 54.3% (Climb WSR), just behind Claude Fable 5.2's 56.6%, but at $5.63 per task versus $35.28 for Claude Fable 5.2, $10.29 for Claude Opus 5.5 and $6.15 for GPT-6 Astra.
More from Models
- Personalized AI assistant Coco lifts user-understanding proxy from 0.199 to 0.515 over 7 days — EchoShao8899 · 2026-11-17
- New MKA Benchmark: 200 Expert-Level Multimodal Tasks Across 83 Occupations — osanseviero · 2026-11-17
- OpenAI Brings in Apollo, METR, Transluce and Goodfire for Embedded Safety Assessments — OpenAI · 2026-11-17
- Gemini Decisions API Judges 1,000 Questions Over 256K Tokens With Zero Output Token Billing — _philschmid · 2026-11-17
- RWKV-8 RPU preview hits 12,500+ tokens/s real-time inference — kastnerkyle · 2026-11-17
- Gemini 4 Helix spotted in Google Antigravity, hinting at another Gemini 4 variant — feblet · 2026-11-16