MineBench US map test: Fable 5 most reliable at text, Opus 5 more accurate, GPT-5.6 Sol mirrors letters

ENT_Alam · reddit · 2026-08-29

Using his Minecraft-style 3D building benchmark MineBench, the author had frontier models build a US state map: Opus 5 used twice as many blocks as Fable 5 (Fable more efficient) but produced the more accurate build; GPT-5.6 Sol Pro consistently mirrored text; Fable 5 has been the most reliable model for text orientation, while others occasionally flip letters.

MineBench 4.0: now on the iOS App Store; supports A/B testing of private model checkpoints for several labs (LM Arena-style policies); added a Community Gallery for showcasing and upvoting custom prompts into the official benchmark. Logged-in users get unlimited Gemini 3.7 Flash generations for a limited time, thanks to Google DeepMind.

Original post →

More from Models

Models channel →