spaCy author finds small Jev model matches Opus classifier 95% of the time

spaCy creator Matthew Honnibal reported that Typesafe's small Jev model agreed with an Opus-powered few-shot text classifier on 95% of labels, suggesting smaller models can replace large ones in such tasks.

2026-10-21 ~ 2026-10-21 · 2 related posts

• Small model Jev matches Opus on 95% of few-shot classifier calls; disagreements refine prompt — honnibal · 2026-10-21
• spaCy Creator Tests Jev: 95% Agreement with Opus Few-shot Classifiers — honnibal · 2026-10-21