Weakest models gain most from tools: MiMo-V2.6-Pro jumps 5% to 43% on VIALS-AA
ArtificialAnlys · x · 2026-11-12
Artificial Analysis analyzes where tool-use gains concentrate on VIALS-AA: the biggest gains go to models that score lowest without tools.
- The ten models below 31% without tools average 42 tool calls per task; the seven above average only 23
- MiMo-V2.6-Pro shows the largest gain: 5% → 43% (49 calls/task); Gemini 3.8 Flash (high) goes 16% → 41% with 68 calls per task
- Astra and Sol make the fewest calls (8/task), gaining just 13 and 16 points — strong models largely one-shot the tasks
More from Models
- Redditor tests Google's new gemini-decision-1 on real-world what-if probability calibration — elvano124 · 2026-11-12
- Users complain Google AI Mode tightened safety filters, blocking fanfiction requests — Designer_Lion2913 · 2026-11-12
- Hassabis RTs tease that Gemini 4 carbon is 'awesome', results coming soon — demishassabis · 2026-11-12
- Aside's Computer Use agent claims SOTA on Scale AI's Cua Driver Bench — brandon_galang · 2026-11-12
- Inflect v3 ships six-voice local TTS in just 34M parameters, Apache 2.0 licensed — b111ue · 2026-11-12
- Can LLMs be trained to commit heresy? Post-training against conformity, rewarding truth by outcomes — dioscuri · 2026-11-12