Frontier models solve 86% of a brand-new puzzle game — videogame evals are dead

gleech · x · 2026-11-17

A Paradigm 3 report by Zanichelli, Hambly and Leech tests GPT-6 Astra and GPT-6.1 Sol on Order of the Sinking Star, a game released after their training:

Related event: GPT-6 models solve 86% of a brand-new puzzle game, study finds(2 posts)→

Original post →

More from Research

Research channel →