Standardized decision model support coming to transformers, batching-friendly
LysandreJik · x · 2026-10-12
Closing post of Lysandre's decision-model thread.
- The approach works very well with batching: many decisions (routing, scoring, yes/no questions) can be batched into a single forward pass.
- It also works with VLMs, which is what makes the microducks demo possible.
- Docs available at /v1/systemone for the transformers serve CLI; standardized decision model support in transformers is coming soon, thanks to @marcsun and @artzucker.
More from coding & agent
- Rigging in Blender via MCP: six-step recipe for Opus 5.5 to build and animate 3D scenes — sidahuj · 2026-10-12
- Diorama gives each agent its own git worktree — and bangs a giant gong when stuck — davidfromkansas · 2026-10-12
- Tracking people across home security cameras with cheap frame sampling and Haiku 5.5 — indragie · 2026-10-12
- How the cat dashboard works: Ring's AI tagging plus 1fps still frames fed to the model — indragie · 2026-10-12
- He built a cat activity dashboard with Opus 5.5 by sniffing Ring, Petlibro and Whisker app traffic — indragie · 2026-10-12
- Diorama breaks down agent work into abstraction layers so you can see what's happening — davidfromkansas · 2026-10-12