New Minecraft benchmark KradleBench: GPT-6.2 Astra edges a skilled human 78.3 vs 77.2 across 13 challenges

TheMrZZ0 · reddit · 2026-11-20

The KradleBench team released a Minecraft AI benchmark: 26 models, 13 challenges, 345 games per model. GPT-6.2 Astra topped the board at 78.3/100, just above skilled human player SethBling's 77.2; the next model, GPT-6.2 Sol, scored 67.9.

How it works: agents receive text observations (position, health, inventory, nearby blocks, chat) and act by writing JavaScript. Five weighted dimensions: Collaboration 30%, Strategy 30%, Conflict 30%, Logic (redstone) 5%, Creativity 5%.

Standout findings:

Full leaderboard, per-challenge results and replays at kradle.ai.

Related event: KradleBench Launch: GPT-6.2 Astra Edges Out Minecraft Legend SethBling(8 posts)→

Original post →

More from Fun

Fun channel →