GitHub Next open-sources LocalJev, a local Jev-compatible API built on oMLX and DiffusionGemma
gaganghotra_ · x · 2026-09-19
A GitHub Next team member without Jev access spent a morning building LocalJev, an open-source "poor man's Jev" running locally on oMLX.
- LocalJev implements a Jev-compatible POST /v1/systemone API in TypeScript/Bun, backed by DiffusionGemma (default: diffusiongemma-26B-A4B-it-4bit) via an OpenAI-compatible endpoint
- Since oMLX lacks unmerged vLLM diffusion primitives (diffusionseedcanvas, read-only mode, token logprobs), it translates typed Jev decisions into classification prompts, asks for JSON probability scalars/vectors, validates with retries, and normalizes results
- Built with pure prompt coding, it runs well on an M5 Max 64GB; the repo includes benchmark reports covering DiffusionGemma and autoregressive models (Qwen MoE, Gemma 4 MoE, e4b/e2b)
- The server exposes an API compatible with standard Jev wrapper libraries
More from coding & agent
- Dev builds Concat, an open-source CapCut replacement, entirely with AI agents — JUB0T · 2026-09-19
- Dev builds Chrome extension with Jev to auto-tag sites and visualize browsing habits — pramodk73 · 2026-09-19
- One prompt, under $1: coding agent builds a full Django to-do app in 5 minutes — Al_Grigor · 2026-09-19
- One Generic Video Tool or Per-Provider Tools? Debating the Agent Tool Layer — ExcitingBison4616 · 2026-09-19
- Readback: free MIT VS Code extension reads Claude Code replies aloud via Speechify — shauntrennery · 2026-09-19
- WebMCP benchmark: Jev + Mercury 2.5 solves 100% of tasks at 112x lower cost than GPT-6 Astra — hardimanjames · 2026-09-19