Blackbench ranks decision models by how much money they win at blackjack
kukicolaa · reddit · 2026-11-23
Blackbench (blackbench.kukicola.io) is a new benchmark that evaluates decision models by playing blackjack: every model plays the same seeded hands with flat bets and fixed house rules (6D, S17, DAS, LS, 3:2), and is scored by how much money it wins or loses.
Compared to quiz-style evals, scoring with actual monetary outcomes gives an intuitive read on models' risk decisions and strategy execution.
More from Research
- 250k-page machine-verified proof sparks peer review debate around Anthropic result — examachine · 2026-11-23
- P≠NP won't be proved soon, but AI could speed the needed literature 100x — rrwilliams · 2026-11-23
- If P vs NP falls soon it's P=NP, and 'polynomial time' will need redefining — rrwilliams · 2026-11-23
- Complexity researcher rrwilliams lays out three bets on P vs NP — rrwilliams · 2026-11-23
- Fine-tuned Gemma 4 E4B drives 100 villagers offline in a rumor-spread simulation game — AlternativeEnough352 · 2026-11-23
- LingSante-3.1-air-VL tops medical imaging evals across derm, labs and X-rays — Dr_Alex_Crimi · 2026-11-23