OSS Jev alternative is easy to build fast; generalization and calibration are the hard parts

remilouf · x · 2026-09-19

remilouf argues building an OSS alternative to Jev that matches its speed with free output tokens is straightforward, but repros suggest the real difficulty is making it general and well-calibrated — likely a post-training data-quality gap.

He also shares a practical trick: for classification + tool-calling use cases, merging both calls using if/then/else in JSON Schema eliminates a network round-trip for extra speed.

Related event: Dev replicates open-source alternative in minutes on DGX Spark(2 posts)→

Original post →

More from coding & agent

coding & agent channel →