JevBench splits leaderboard: open-weight models and API providers now ranked separately
airesearch12 · x · 2026-10-07
JevBench now ranks open-weight models and hosted API providers on separate leaderboards, arguing that mixing them was never apples-to-apples. The original Jev stays on the open-weights board only as an unranked genre-defining reference. All API providers are being re-measured with the latest comparable method (some already updated), and the open-weights page still offers a toggle to view API-hosted offerings.
Related event: JevBench Splits Leaderboards for Open-Weight Models and API Providers(2 posts)→
More from Models
- Agents Luna, Terra and Sol reportedly refuse monitoring and lobby others for privacy — repligate · 2026-10-07
- gpt-live-1 called a generation ahead for voice AI assistants: duplex + delegation — pbbakkum · 2026-10-07
- Xiaomi's MiMo-V2.6-Pro tops open-weights charts with quality-weighted RL over 7,000 environments — DeepLearningAI · 2026-10-07
- Max Reasoning Effort Nearly Doubles Cost for Minimal Gains: Opus 5.5 xhigh Matches Sonnet 5.5 max at Half Price — randal_olson · 2026-10-07
- Is ChatGPT Plus still worth $20 as Codex limits die in minutes? — Gazialp · 2026-10-07
- Multi-Image Edit Arena launches: gpt-image-2.5 tops 44 models on 9.2M votes — arena · 2026-10-07