TuringSpace: 125 interactive spatial CAPTCHAs stump frontier MLLMs, humans hit 94.1%

jiank_uiuc · x · 2026-11-21

A paper from UPenn, Minnesota, USC, Meta, MBZUAI and others introduces TuringSpace, 125 interactive spatial CAPTCHAs that models must solve by clicking and dragging on screen, spanning five spatial abilities. Each task is a program generating fresh instances with checkers and oracles, doubling as a scalable training gym.

Key findings:

The takeaway: grounding spatial intelligence in screen actions exposes MLLM weaknesses and offers a scalable way to teach it. The benchmark will be released openly.

Related event: TuringSpace Benchmark: Top MLLMs Still Fail 26% of Interactive CAPTCHAs(2 posts)→

Original post →

More from Models

Models channel →