16-game Catan benchmark puts DeepSeek V4.1 Flash at GPT-5.6 Terra level at 6-7x lower cost
teortaxesTex · x · 2026-09-15
Developer @onusoz ran 16 games of Settlers of Catan pitting DeepSeek V4.1 Flash against GPT-5.6 Luna, Terra and Sol, with all runs open-sourced on Hugging Face (364 files, 741MB):
- DeepSeek easily beat Luna; finished games against Terra ended in a 4-4 tie while costing 6-7x less
- Sol generally won, but DeepSeek still took one game off it; Luna had no chance against DeepSeek
- Games with both models on max thinking took too long to finalize
- Models ran via Novita through Hugging Face Inference Providers
teortaxesTex called the comparison fair: in both subjective agentic coding and Catan, DeepSeek V4.1 Flash sits between Terra and Sol at a much lower price. He wants to see ARC-AGI 2 results and notes notable evaluators have been oddly indifferent to this model.
Related event: DeepSeek V4.1 Flash Matches GPT-5.6 in Catan, Aces Spatial Reasoning Test(2 posts)→
More from Models
- Claude upgrade-page traffic rebounded to 17.6M in September, near May's 18.6M peak — firstadopter · 2026-11-02
- Open-source GLiNER-PII scrubs 13 identifiers from a discharge note in 550ms on GPU — MaziyarPanahi · 2026-11-02
- OpenAI Dots user says bloat and broken infra drove him to try newcomer Muse — Koala_Confused · 2026-11-02
- Fable 5.5 reportedly one-shots animation in pure code as Anthropic's coding bet pays off — Hesamation · 2026-11-02
- One agent goal has been running for 4 days, burning 30K tokens — CtrlAltDwayne · 2026-11-02
- Daily AI Brief: Gemini 4 Carbon spotted on Arena, DeepSeek open-sources coding agent — testingcatalog · 2026-11-02