New benchmark reveals poor visual perception in AI models; none reach 60% accuracy
The Decoder · rss · 2026-08-15
Moonshot AI released PerceptionBench, a benchmark designed to isolate visual perception from logical reasoning in multimodal AI models. Results show that all frontier models perform poorly, with none exceeding 60% accuracy; GPT-5.6 Sol leads by a narrow margin. The study suggests that many supposed reasoning failures actually occur during the image reading stage.
More from Models
- Dev: Claude writes 'zero bugs' on healthcare apps, 10x token efficiency — repligate · 2026-10-16
- Shanghai AI Lab unveils Intern Lumina U2, a diffusion LLM unifying image, video and 3D tasks — Shanghai-AI-Laboratory · 2026-10-16
- This Week in Tech breaks down Gemini 4, OpenAI's Dots agents, and Anthropic's leaked IPO filing — LouMM · 2026-10-16
- Sentry CEO Reveals $8,972 Claude Bill as Opus 'Scope Creeps' Through Team Workloads — zeeg · 2026-10-16
- Opus 5.5 wins: Anthropic reclaims token and spend share from OpenAI in 6 days — FinanceYF5 · 2026-10-16
- will.deeb: asking why a minor lab benchmarked against a 2-month-old frontier model is usually a stupid question — willcb · 2026-10-16