22M local model beats JEV 93% vs 80% on Banking77 in 8ms on CPU
Prompt Engineering · youtube · 2026-09-20
The Prompt Engineering channel benchmarks JEV—touted as a brand-new model category—against hype and history:
- Single-pass classifiers date to 2018 and zero-shot label pipelines to 2019, so JEV isn't a new concept.
- Across four tasks vs three established approaches, a 22M-parameter local model scored 93% on Banking77 vs JEV's 80%, running in 8ms on CPU for free.
- JEV's real edge: dynamic instruction following, something the older approaches can't match.
- The video also covers the 'System One models' framing and hybrid architectures.
More from Models
- Tencent Hunyuan Launches Hy4 with Vision, Claims Top Tier Among Open Models — TencentHunyuan · 2026-11-04
- Claude Code fixes game copyright refusal rule in 2.1.317: naming a game now works — apples_jimmy · 2026-11-04
- Microsoft Phi-4-mini: a 3.8B model with 128K context and 52.8 MMLU-Pro — goyalshaliniuk · 2026-11-04
- Mistral Ministral 3 3B ships in base, instruct and reasoning variants — goyalshaliniuk · 2026-11-04
- 7 small language models to watch in 2026–27, from Qwen3.5-4B to LFM2.5-1.2B — goyalshaliniuk · 2026-11-04
- Users report Claude Opus 5.5 quality seemingly degrading this week — ayushtweetshere · 2026-11-04