LISL: a lightweight agentic loop claiming 1.2 tasks per token on a local Gemma 12B

MammothTreat6751 · reddit · 2026-11-12

The author shares LISL, a lightweight implementation-style agentic loop, claiming "1.2 tasks per token." The accompanying screenshot shows LM Studio running Gemma 4 12B QAT locally: a local REST API server with tool calling, a system prompt casting the model as a "GBA game architect" designing turn-based tactical games, logs showing 2.2 tok/s inference and 20k+ token task runs.

It's essentially a demo of running a minimal agent loop on consumer local models, though the post itself gives almost no implementation detail.

Original post →

More from coding & agent

coding & agent channel →