Blackbench ranks decision models by how much money they win at blackjack

kukicolaa · reddit · 2026-11-23

Blackbench (blackbench.kukicola.io) is a new benchmark that evaluates decision models by playing blackjack: every model plays the same seeded hands with flat bets and fixed house rules (6D, S17, DAS, LS, 3:2), and is scored by how much money it wins or loses.

Compared to quiz-style evals, scoring with actual monetary outcomes gives an intuitive read on models' risk decisions and strategy execution.

Original post →

More from Research

Research channel →