Ellf goes free for solo devs, with a systematic method to eval model swaps

honnibal · x · 2026-11-03

Ellf is now free for solo developers working locally. It gives coding assistants an execution layer, annotation tool, and a decade of NLP know-how via its Jev project template for migrating projects from models like Opus to Jev. The author outlines a systematic eval: run the same texts through both systems, measure overlap, hand-annotate disagreements — e.g. 90% agreement, then labeling shows Jev matches your annotation 60% vs Opus's 40%; annotations then feed back into Jev's instructions or confidence thresholds. Ellf removes the friction: the agent finds the template, runs jobs in background, and queues annotation work.

Related event: spaCy Makers Launch Ellf, Free for Solo NLP Developers(4 posts)→

Original post →

More from coding & agent

coding & agent channel →