jeff: an open-source self-hosted drop-in replacement for jev, powered by GLiFormer
JiliJeanlouis · x · 2026-09-19
Logan Markewich open-sourced jeff, a self-hosted drop-in replacement for TypeSafe's jev System One API, powered by knowledgator's GLiFormer (400M parameters).
- Drop-in compatible: point TYPESAFEBASEURL at jeff and use the official typesafe-sdk. Supports choice, score, and noul calls.
- Trade-off: same latency, cheaper self-hosting, with a mild accuracy hit on reasoning-heavy tasks (benchmarks in repo).
- Easy deploy: uv + Python 3.12, one command to serve locally with CUDA → MPS → CPU device selection.
The author argues jev's real value is its simple, composable API, and that jev itself boils down to a classifier/encoder — same as GLiFormer — making a local substitute viable.
More from coding & agent
- Readback: free MIT VS Code extension reads Claude Code replies aloud via Speechify — shauntrennery · 2026-09-19
- GitHub Next open-sources LocalJev, a local Jev-compatible API built on oMLX and DiffusionGemma — gaganghotra_ · 2026-09-19
- WebMCP benchmark: Jev + Mercury 2.5 solves 100% of tasks at 112x lower cost than GPT-6 Astra — hardimanjames · 2026-09-19
- Musecases Launches: A Community-Voted Prompt Library for AI Agents — ChrisUniverse · 2026-09-19
- ~40,000 passing tests: dev explains why he doesn't review every line of AI code — doodlestein · 2026-09-19
- NVIDIA's SoL-Pi GitHub repo: auto-research loops for efficient agent harnesses — aigclink · 2026-09-19