OpenJev open-sources Jev-style semantic decisions on a single RTX 3090 with a frozen 4B model

alexcovo_eth · x · 2026-09-17

OpenJev is a new open-source project asking whether something like TypeSafe's closed Jev service—runtime-defined semantic decisions—can run at home on a single RTX 3090. It's available now with no waitlist, including a browser-based WebGPU demo.

The core insight: most agent decisions are small (routing, retries, evidence checks), and chat models waste time generating text that software immediately parses back into an if statement. OpenJev's baseline instead reads typed option probabilities directly from a frozen 4B model—no answer sentence, no JSON repair, no decoding loop.

Benchmarks use the same frozen 4B model, state, and 21 questions, measured separately and aligned at t=0 in replay. The project reproduces Jev's interface pattern, not its undisclosed model or training. It has already gathered 368 stars on GitHub.

Related event: OpenJev: open-source Jev-style semantic decision interface runs on a single RTX 3090(2 posts)→

Original post →

More from coding & agent

coding & agent channel →