JevBench v1.2 launches: a cost-adjusted benchmark ranking for Jev-class decision models
airesearch12 · x · 2026-09-20
Benchmark Heaven released JevBench v1.2, a self-built leaderboard focused on ranking "Jev-class" (cost-efficient decision) models. It supports sorting by composite score, coding, agentic tool use, science, and long context, with adjustable input/output price weightings and task costs computed from OpenRouter usage, plus filters for EU hosting, data confidentiality, and open weights. The author notes the current leader holds its spot, but the gap is narrowing.
More from Research
- Gradient-free weight editing cuts VLM FigStep attack success from 49% to 2% — lateinteraction · 2026-11-04
- Anthropic says it may imminently hit RSP threshold for AI-accelerated R&D, releases provable inference work — tobyordoxford · 2026-11-04
- Google scanned 1,033 real household products, packed into a 345 MB GLB for three.js — victormustar · 2026-11-04
- These 10 GPU optimization papers are why your model runs fast today — NandoDF · 2026-11-04
- INT8 isn't the problem: I benchmarked samplers on INT8 flow models — YakovSava · 2026-11-04
- Karpathy Boosts Open Hacker News Dataset: 10M+ Posts Usable as a Personal Knowledge Base — huangyun_122 · 2026-11-04