Ethan Mollick's D&D Encounter Test: watching AI models fight mind flayers
eldonredwards · x · 2026-09-08
Ethan Mollick proposes the "Encounter Test," a nerdy AI benchmark: have a model simulate a D&D fight between two creatures and see how long it takes to break the rules. GPT-4o did best; Gemini was cute with similar outcomes.
Two years later he re-ran it with a stronger model ("GPT-6"): its mind flayer even got a "101-bone skeletal rig." He built Underdark Duel, a reproducible web page logging every roll, with adjustable encounters and downloadable records. Under 5E 2014 rules he found no major errors, though the mind flayer's tactics could be more creative.
Related event: Ethan Mollick Proposes 'Encounter Test' Benchmark Using D&D Battles(2 posts)→
More from Fun
- Grok bot's 7:30am sales pitch for saving your card to buy robot body parts — VoidStateKate · 2026-10-26
- Cybersecurity meme: the real threat is 'Steve from IT,' not superintelligence — McDonaghMatthew · 2026-10-26
- Anthropic's S-1 founders' letter 'marked safe from using Claude' draws skepticism — xeophon · 2026-10-26
- Mystery app icon spotted on Apple exec's unreleased foldable iPhone sparks guessing — demian_ai · 2026-10-26
- Creator makes 10,564-frame animated short entirely with Gemini toolchain — AI_Andrew · 2026-10-26
- Dev gains 30k Douyin followers from one 20-second video, cashing in X clout — AlchainHust · 2026-10-26