GPT-5.5 scores 10.6% on ActiveVision as humans hit 96.1%
Justgototheeffinmoon · reddit · 2026-07-24
A new arXiv paper says frontier vision models still struggle on ActiveVision, a benchmark designed to require repeated visual perception rather than one-shot description.
- GPT-5.5 scores 10.6% at its highest exposed reasoning-effort tier and gets 0 on 11 of 17 tasks.
- Claude Fable 5 reaches only 3.5%, despite topping many reasoning and coding leaderboards.
- Three humans average 96.1%.
The authors say the point is not just that a vision model failed a new benchmark, but that the failure is highly structured and the models cannot repair it by writing their own code.
Related event: ActiveVision Benchmark Reveals Frontiers in Vision Models Lag Behind Humans(3 posts)→
More from Models
- Only 2 of 25 full ChatGPT rewrites flagged 100% AI by detectors — paulnovosad · 2026-10-26
- Qwen 4 Reportedly Spotted in the Arena, Hints at Alibaba's Next-Gen Model Testing — AIFlow_ML · 2026-10-26
- Nathan Lambert's first open models lecture: distillation, risks and the ecosystem explained — natolambert · 2026-10-26
- Nanbeige 4.3-33B flops real-world test: zero compilable output vs Qwen — julianharris · 2026-10-26
- Claude's safety classifier blocks SS7 defense research, pushing a security dev to an abliterated GLM — l4rz · 2026-10-26
- Black Forest Labs open-sources 5.6B FLUX 3 Image Klein, +91 Elo with 38% fewer params — dl_weekly · 2026-10-26