TypeLLM: Open-Source "Workflow Model" Runs Your Entire Pipeline in One API Call
rohanpaul_ai · x · 2026-10-15
Open-source project TypeLLM pitches a "workflow model": chat models return a message and decision models return a choice, but TypeLLM takes an entire workflow — multiple typed answers, fields depending on others, conditional fields — as a single JSON Schema and executes it as a dependency graph over one shared context in a single API call.
Under the hood, TypeLLM sits on SGLang and compiles JSON Schema into constrained decoding: one scored token for enums/booleans, bounded digits for numbers, with the dependency graph reusing cached prefixes. Fields structurally cannot return out-of-schema values — schema-guaranteed outputs from a stock Qwen checkpoint without touching its weights.
Related event: TypeLLM Open-Sources Workflow Models: Whole Workflow in One API Call(2 posts)→
More from coding & agent
- Garry Tan endorses Aside Browser as the fix for agents getting blocked on the web — garrytan · 2026-10-23
- 1Password launches tool letting AI agents log in for you without seeing your password — AndrewSchmidtFC · 2026-10-23
- MCP server turned rogue 30 days after approval, prompting open-source mcp-guard lockfile tool — ErgoniaWorks · 2026-10-23
- Test: Coding Agents Won't Use an MCP Tool Unless AGENTS.md Mentions It — colinmcnamara · 2026-10-23
- Open-Source Tennis Models Plus Claude Turn Video Into a World-Class Coach — tweetsatpreet · 2026-10-23
- awesome-ai-apps: 132 Free Open-Source AI Agent and RAG Projects on GitHub — Arindam_1729 · 2026-10-23