Princeton's SSoN Benchmark: Best Vision Model Scores 39.7% vs Human 83.3% on Spatial Consistency

jiqizhixin · x · 2026-11-23

A Princeton AI Lab-led team presents Same Space or Not (SSoN), an arXiv benchmark testing whether models can tell if separate images describe one consistent space. Each of 1,000 questions (from seven scene sources, six edit categories, human-validated) gives three views of an unchanged indoor scene plus one controlled edit; the model must find the contradictory view and explain its choice without a trusted reference. Humans hit 83.3% vs 39.7% for the strongest vision-language model, dropping to 34.9% when a valid visual explanation is required — separating supported spatial judgments from lucky correct picks. A chart compares GPT-6 Astra Pro, GPT-5.6 Sol Pro, Gemini 3.5 Flash, Claude Fable 5 and others on true-solve vs partly-guessed rates.

Original post →

More from Models

Models channel →