Explosion's Vibe NLP workflow beats GPT 5.6 Sol on NER data at 1/25th the cost with fewer errors

honnibal · x · 2026-11-23

Explosion founder Matthew Honnibal published a "Vibe NLP" workflow where a coding agent like Claude Code drives a multi-step pipeline to cheaply produce high-quality NER training/eval data using open-weight models.

How it works:

Results: on two small corpora (tools/tech mentions in HN posts; news text with PERSON/ORG/PRODUCT/GPE), the consensus of 3–5 open-weight models tied GPT 5.6 Sol on one task and beat it on the other at 1/25th the runtime cost; after light human review, the data had 50–60% fewer errors than GPT 5.6 Sol's output on both tasks.

Aim at teams needing domain NER data who find frontier models "almost good enough but too expensive."

Related event: spaCy Creator Open-Sources 'Vibe NLP' Pipeline for Low-Cost NER Data(2 posts)→

Original post →

More from coding & agent

coding & agent channel →