Free DiffusionGemma endpoint returns sentence probabilities in ~230ms, OpenAI-compatible
victormustar · x · 2026-09-21
A developer deployed a free experimental endpoint running open model DiffusionGemma 26B-A4B with vLLM PR #57250 (structured reads), available for a few days:
- POST a sentence plus your own options and get probabilities back in 230ms: yes/no, multiple choice, scores, and images supported
- Speaks the Jev /v1/systemone API so existing SDKs work unchanged; the same URL also serves a standard OpenAI-compatible chat endpoint
- No token or signup, light rate limiting, with docs, a playground, and curl/Python guides
- Tested with Matt's exact same sentences: mostly matching answers, with fun misses (it thinks Luigi is blue)
More from coding & agent
- Agent Attack Paths Measured: Browser Content Leaks 11/12, MCP Config 8/8, Shell 0/14 — DaimoNNN · 2026-09-21
- Dev builds SkillBill, a Kotlin orchestrator that turns a Linear ticket into a merged PR — Sermilion · 2026-09-21
- SkillBill: A Kotlin Orchestrator That Runs AI Coding Agents Through 7 Enforced Phases — prakersh · 2026-09-21
- Know your codebase or your AI agent will go rogue, warns PyLate author — antoine_chaffin · 2026-09-21
- Amp CEO shares 'The Amp Way': proactive apologies and credits turn bug fixes into a virtuous cycle — HankYeomans · 2026-09-21
- Internal Bot Audit Reveals AI Agents Run With Far More IAM Access Than Needed — Careless_Sabfey_4906 · 2026-09-21