JevBench v1.2 launches: a cost-adjusted benchmark ranking for Jev-class decision models
airesearch12 · x · 2026-09-20
Benchmark Heaven released JevBench v1.2, a self-built leaderboard focused on ranking "Jev-class" (cost-efficient decision) models. It supports sorting by composite score, coding, agentic tool use, science, and long context, with adjustable input/output price weightings and task costs computed from OpenRouter usage, plus filters for EU hosting, data confidentiality, and open weights. The author notes the current leader holds its spot, but the gap is narrowing.
More from Research
- Stanford's SALVE decodes hidden behaviors smuggled in distillation data — burny_tech · 2026-09-20
- New paper detects overfitting directly from weight matrices without any data — burny_tech · 2026-09-20
- Harvard Releases Full Lecture Notes for Its Dynamical Systems Course — burny_tech · 2026-09-20
- Databricks Co-founder: If Starting a PhD Today, I'd Work on Reward Hacking — burny_tech · 2026-09-20
- Gaussian Processes Explained: Bayesian Nonparametric Regression With Built-in Uncertainty — burny_tech · 2026-09-20
- ML paper explosion outpaces reviewer pool, peer review is getting 'vibey' — burny_tech · 2026-09-20