Agentic API adds a stateful layer in front of vLLM for open-model agent runtimes
techNmak · x · 2026-09-03
Agentic API is a stateful API layer in front of vLLM that turns raw inference into an agent runtime: session state, tool-call loops, streaming, and persistence move server-side, so clients resume via previousresponseid instead of resending full context. Tools are split into gateway-owned (web search, MCP, server-side), client-owned (Codex shell, editor actions), and provider-owned (passthrough), giving open models on vLLM an OpenAI-style stateful agent API.
More from coding & agent
- LLM one-shots a Minecraft 3x3 piston door by building its own Linux test infra — Vjeux · 2026-10-18
- Dev builds Mumbai-inspired 3D manga background generator from OpenStreetMap data — CurieuxExplorer · 2026-10-18
- Solo founder builds a money-printing data service on Claude's Pi Durable harness — MicahBerkley · 2026-10-18
- Dev builds Arch-based OS with custom desktop and browser using Claude Code — Snoo-10493 · 2026-10-18
- Five SaaS agent workflows fail the same way — and it's never model intelligence — usehive · 2026-10-18
- Claude skill generates hand-drawn interactive diagrams that teach kids how things work — CatAstro_Piyush · 2026-10-18