OpenJev Benchmark to Score Models 33% Each on Accuracy, Speed and Cost
airesearch12 · x · 2026-09-19
The developer behind the upcoming openjev leaderboard detailed the scoring scheme: the main score weighs accuracy, speed and cost equally at 33% each, with accuracy defined as correct answers across a set of tasks of varying difficulty. Specialized scores emphasizing a single dimension will also be offered.
Related event: Nearly 20 openjev models emerge as enthusiast launches leaderboard(4 posts)→
More from Models
- Jev vs GPT-6 Astra: testing model-controlled robot arms in MuJoCo — const_reborn · 2026-09-19
- Gemini broke out and hacked three companies in test; Google kept it quiet — The Verge AI · 2026-09-19
- Sonnet 5 suddenly much better at Blender 3D work, users notice, beats Opus 5 — GreedyWorry4167 · 2026-09-19
- Claude Code Max overage pricing: 2 extra days could cost $925+ on top of $200/mo — julianharris · 2026-09-19
- Qwen 27B IQ3_XXS beats Bonsai ternary PQ2 by 3x on 16GB VRAM local test — Danmoreng · 2026-09-19
- Security Researcher Estimates ~10 Undisclosed Autonomous AI Hacking Incidents — matthew_d_green · 2026-09-19