340M open model matches fine-tuned Jev on two clinical tasks, zero-shot on CPU
MaziyarPanahi · x · 2026-09-29
Developer Maziyar Panahi reports that fastinoAI's open GLiNER2.5-Decide (340M params) ran zero-shot on a CPU — with zero fine-tuning — and scored a perfect 12/12 on two clinical NLP tasks (assertion status and allergy documentation), matching the fine-tuned model Jev.
The full benchmark stands at 36/48 versus Jev's 48/48, but the zero-shot result is striking. He's inviting others to fine-tune it on clinical notes to close the remaining gap.
Related event: 340M Open-Source Model Aces 12/12 Clinical Tasks Zero-Shot on CPU(3 posts)→
More from Models
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- AI daily: DeepSeek rate-limits chats, Qwen haggling spurs shop warnings, Doubao workspace launch — 快鲤鱼 · 2026-11-16
- Nathan Lambert calls out Ethan Mollick for 'selectively ignoring' Kimi in model comparisons — natolambert · 2026-11-16
- Eval Firm Trajectory Told 40 Agents "NEVER Stop" in Harness Without Telling Epoch — peterwildeford · 2026-11-16