Decision Index benchmarks 275 models, with several now natively supported in transformers
tomaarsen · x · 2026-11-10
tomaarsen highlights the growing ecosystem of decision models: beyond a transformers integration, many can also be run via llama.cpp. He points to the Decision Index, an extensive benchmark spanning 275 models, plus a filter to browse which decision models exist — useful for picking models for routing/judgment tasks.
Related event: Hugging Face Transformers Introduces Decision Models Primitive(6 posts)→
More from Models
- Google and Artificial Analysis launch MKA benchmark; Gemini 4 Carbon ranks #2 at 6x lower cost — GoogleDeepMind · 2026-11-11
- Google DeepMind launches Gemini 4 Carbon, its strongest model for long-horizon tasks — GoogleDeepMind · 2026-11-11
- DeepMind's MKA benchmark splits frontier agents: 95-97% on basics, 28-57% on hard tasks — ArtificialAnlys · 2026-11-11
- MKA deep dive: top models cluster at 95-97% on basics but split 28-57% on hard tasks — ArtificialAnlys · 2026-11-11
- Same MKA task: Gemini Carbon does it in 1 hour for $8, Fable takes 3 hours and $68 — ArtificialAnlys · 2026-11-11
- MKA Benchmark by Output Type: No Model Tops 52% on Word or Text Files — ArtificialAnlys · 2026-11-11