OpenJev Benchmark to Score Models 33% Each on Accuracy, Speed and Cost
airesearch12 · x · 2026-09-19
The developer behind the upcoming openjev leaderboard detailed the scoring scheme: the main score weighs accuracy, speed and cost equally at 33% each, with accuracy defined as correct answers across a set of tasks of varying difficulty. Specialized scores emphasizing a single dimension will also be offered.
Related event: Nearly 20 openjev models emerge as enthusiast launches leaderboard(4 posts)→
More from Models
- Community asks Moonshot when Kimi K3.1 model weights will drop — bgmshana · 2026-11-04
- Meta's Muse Spark Open license counts distilled models as derivatives — aidenclarke_12 · 2026-11-04
- Tencent Hy4 trails GPT-6.1 on hard tests as Kimi K3.1 Pro beats it on two benchmarks — heyshrutimishra · 2026-11-04
- Tencent's Hy4 agent self-trained a smaller model that beat Tencent's own baseline — heyshrutimishra · 2026-11-04
- Hy4 tops open models in finance eval at 3.04, hallucination rate cut to 5.45% — heyshrutimishra · 2026-11-04
- Tencent Hunyuan teases upcoming LMArena debut — TencentHunyuan · 2026-11-04