Decision Index 0.3.2 ranks 148 open reproductions of TypeSafe Jev's Decision Model
capetorch · x · 2026-10-13
A post praising a new Hugging Face space actually showcases "Decision Index 0.3.2": a leaderboard of 148 open reproductions of TypeSafe Jev's "Decision Model", ranked by a Full score combining 37 public benchmarks plus private tests and tasks from new domains, covering 149 models from <50M to 6.2B parameters across fine-tuning methods (full fine-tune, LoRA, adapters, inference techniques), with text and vision tracks.
The reference Jev model leads at 60.1, followed by qLLM-SR-4B-mini-IBL at 52.6; reproductions run on a single NVIDIA RTX PRO 6000.
More from Models
- LLM judges favor their own company's models on close debate questions — Trainer_28 · 2026-10-13
- Developer slams Anthropic's self-replication demo as fear-mongering that conflates capability with open weights — tobowers · 2026-10-13
- Developer Says GPT Models Lost Their Fun Due to Sub-20 Tokens/Sec Speed — lucasmeijer · 2026-10-13
- Letting Opus 5.5 Train a Model Autonomously: It Scales Up and Picks Transformer Over Conv U-Net — Angaisb_ · 2026-10-13
- Muse Wonder plays Stronghold Crusader on an old laptop as Hesamation benchmarks LLMs on a classic RTS — Hesamation · 2026-10-13
- Scaledown's specialized models claim 200x faster, 467x cheaper inference with 1M-token context — cneuralnetwork · 2026-10-13