Astra saw through perturbed Zork observations, calling it a 'variant'

tw_killian · x · 2026-09-28

An experiment recap shows that after Astra beat Zork, researchers perturbed its observations to hide which game it was playing — and failed, as Astra explicitly noted it looked like a Zork 'variant'. The post suggests testing whether Astra's Nethack scaffolding survives similar perturbations, hinting the agent may rely on memorized game knowledge rather than pure generalization.

Original post →

More from Fun

Fun channel →