Jev excels at graduate-level knowledge, Python function choosing, tool calling and model routing
multimodalart · x · 2026-09-22
multimodalart adds more Jev benchmark details: the model performs particularly well on knowledge-based questions up to graduate level, Python function choosing, tool calling, and model routing. This complements earlier findings that Jev struggles with reasoning games like chess, hard document retrieval, chord recognition, and fine-grained sentiment analysis.
Related event: Jev model shines in tool use, lags in reasoning and retrieval(2 posts)→
More from Models
- Google's Physical-Engineering's Last Exam: all 14 frontier models score below 50% — dl_weekly · 2026-11-12
- Commit leak reveals unreleased Gemini 4 variants: Argon, Hydrogen and Helix (unconfirmed) — BlackHC · 2026-11-11
- Rewiring just 89 of 442,368 neurons in Qwen3-8B matches full SFT for a persona — maxsloef · 2026-11-11
- Unsloth ships Qwen3.8-27B Dynamic V3.1 GGUFs with 5-10% accuracy gains — danielhanchen · 2026-11-11
- Zvi: being forced back to an older model is the best reminder of AI progress — TheZvi · 2026-11-11
- Screenshots Made a 4B Browser Agent Worse: A Postmortem With Real Numbers — Stunning-Sherbet1853 · 2026-11-11