NetHack benchmark reportedly solved after years of slow LLM progress

PMinervini · x · 2026-09-25

Reports on X suggest the NetHack Learning Environment (NLE) benchmark may have finally been "solved." NLE has been open since 2020, and since 2024 it has been used to evaluate frontier LLMs, with progress long described as slow and far from complete. The "solved" claim comes via a surprised retweet; details remain to be verified.

Original post →

More from Models

Models channel →