ActiveVision benchmark finds frontier vision models far behind humans at repeated visual reasoning
OfirPress · x · 2026-07-24
ActiveVision is a new benchmark for testing whether models can repeatedly observe, reason, and seek new visual evidence instead of making a single glance decision.
- Humans solve 96.1% of the tasks.
- The best frontier model reaches only 10.6%.
- Even strong models such as Fable 5 score just 3.5%.
The result suggests current vision models are still far from robust multi-step visual reasoning in interactive settings.
Related event: ActiveVision Benchmark Reveals Frontiers in Vision Models Lag Behind Humans(3 posts)→
More from Research
- Alex Townsend posts 200 open problems in numerical linear algebra for humans and AI agents — IgorCarron · 2026-09-11
- Navier-Stokes, Riemann, P vs NP: what this week's math buzzwords mean for you — koltregaskes · 2026-09-11
- Fruit fly brain as an LLM: connectome-driven language model demo goes live — ngxson · 2026-09-11
- Harry Collins: LLMs can't do frontier science because they can't invent new language — whoamisri · 2026-09-11
- The Waymo effect: how AI is quietly making research less collaborative — JohnHammersley · 2026-09-11
- Causal-only attention for non-generative tasks is wasteful, argues HF engineer — antoine_chaffin · 2026-09-11