Visual Cipher Bench: best frontier model solves only 26.7% of long-horizon visual puzzles

_akhaliq · x · 2026-11-17

Einsia AI, Navers Lab, and Tsinghua University introduce Visual Cipher Bench, testing whether agents can discover rules hidden in images with no written rules and no correctness feedback within 60 minutes.

Takeaway: coding agents grind long tasks with specs and test suites, but long-horizon visual reasoning without feedback remains a near-total failure mode. Paper, code, and leaderboard are open.

Related event: New Visual Cipher Bench Leaves Best AI Models at 26.7% Accuracy(2 posts)→

Original post →

More from Models

Models channel →