Open-source ninfer runs Jev-style decisions on Qwen3.8 27B at 84.4% accuracy
Unlucky-Message8866 · reddit · 2026-09-21
A Redditor built a Jev-like native decision API on Qwen3.8 27B with their open-source ninfer framework. On JevBench v1.2's public set (231 typed decisions) it scores 84.4% accuracy (vs 86.6% for official Jev 1.13.0), with excellent calibration (ECE 0.045, Brier 0.081) and p50 latency of 127ms on an RTX 5090. Easy tier hits 100%, hard tier 69.4%; weakest families are temporal-numeric (33%) and probability (50%). Self-described dirty POC with known allocation bugs; weights on HuggingFace.
More from Models
- Jev explained: millisecond decisions at a fraction of LLM cost — multiply_matrix · 2026-09-21
- Four system-one decision models released in just three days, a rare open-source race — arpit_bhayani · 2026-09-21
- Scoop: OpenAI preps GPT-6 Sol and Luna launch as Anthropic nears Opus 5.5 — daniel_mac8 · 2026-09-21
- Grok 4.7 reportedly released, details still unconfirmed — koltregaskes · 2026-09-21
- Medmarks adds results for mid-size open LLMs, Gemma 4 31B leads the class — iScienceLuvr · 2026-09-21
- PlotWeaver begins training Pan-African voice model covering 68 African languages across 44 countries — madeofAjala · 2026-09-21