stuntd: a local proxy that learns your LLM decisions and serves them at 22ms without an API key
Inevitable-Log5414 · reddit · 2026-09-23
A Reddit user open-sourced stuntd (Apache-2.0), a local proxy for closed-choice LLM decisions (choice, yes/no, score). It records your traffic, trains a small head on frozen-encoder Laya, runs in shadow mode, and only goes live once it matches your provider at the target agreement rate.
Why it matters
- Jev's hosted API costs 380ms per round trip; Laya answers in 22ms on a laptop GPU but scores 38% zero-shot on banking77 vs Jev's 76%
- After training: Snake plays 99.6% of moves locally, support triage answers 90% of questions locally, a coding-agent command gate goes from 45% to 97% accuracy (96% local)
Limits
- Closed decisions only; frozen encoder can't do arithmetic — "amount > X" scores 0.42 while a natural-language version hits 0.94
- Ships a 20-line PreToolUse hook that gates Claude Code shell commands with a local commandgate question
More from coding & agent
- User runs Opus 5.5 at max to write a ComfyUI wildcard — it did 20,000 iterations over a/an grammar — mwoody450 · 2026-09-23
- Solo creator builds AI action short with MiniMax, Tripo and Blender — shares full workflow — Spoonman915 · 2026-09-23
- Microsoft's Agensh Scales Multi-Agent Systems to 1,024 Agents Without a Central Orchestrator, Boosting Test-Pass Rate to 55% — andrew_n_carr · 2026-09-23
- Viral demo claims 'GPT-6' can drive browser Paint to draw, unverified — alexcovo_eth · 2026-09-23
- Parallel coding agents merge cleanly and silently break every test — RunAI_Coder · 2026-09-23
- Getting phone-captured text into your computer: OCR, vision models, agentic pipelines — silenceimpaired · 2026-09-23