JevBench v1.5.4 ditches cost-weighted scoring; Original Jev returns to top of leaderboard

airesearch12 · x · 2026-10-02

JevBench v1.5.4 changes its headline metric from Composite Score to Capability Score, arguing that speed and cost rest on too many assumptions and are too easy to game. Original Jev now tops the leaderboard, followed by Winnow, Cygnet, and Surogate Rune. The Benchmark Heaven platform also offers filters for price weighting, EU/China/US hosting, and data confidentiality policies.

Related event: JevBench switches to Capability Score and adds custom cost controls(3 posts)→

Original post →

More from Models

Models channel →