DiffusionGemma becomes an open, self-hostable decision model on vLLM amid Jev's viral 'System One' moment
rseroter · x · 2026-09-29
A Red Hat Developer post shows how to run DiffusionGemma on vLLM and Red Hat AI to build an open, self-hostable decision engine. Context: Jev from TypeSafe AI (founded by ex-OpenAI researcher Diogo Almeida) recently went viral — a model that doesn't chat but returns typed, probabilistic decisions via three question types (Choice, Score, Noul), inspired by Kahneman's 'System One' thinking. Enterprises already run small models as zero-shot classifiers; Jev's contribution is a model and API purpose-built for the role: low latency, low cost, guaranteed structure, probabilities as normal output. DiffusionGemma was already a Red Hat AI validated model, and the vLLM community turned it into a self-hostable alternative.
More from coding & agent
- Nine unlikely trends reshaping software development, per InfoWorld — rseroter · 2026-09-29
- DAYJOB Benchmark: Top Agents Pass Only ~24% of Real 9-to-5 Work Tasks — echen · 2026-09-29
- MiniMax H3 ecosystem roundup: Character-Swap LoRA final version, retro sci-fi LoRA, ComfyUI Face Refine node — optimisticalish · 2026-09-29
- I Built an Agent to Apply for Software Jobs — and Ended Up Interviewing the Hiring Manager — Srivani_Parimi · 2026-09-29
- Engineer's periodic reminder: read the code you ship to prod — you're an engineer, not a prompter — tlakomy · 2026-09-29
- Manus Launches AI Agents With Their Own Email, Phone Number and Digital Wallet — Polymarket · 2026-09-29