Reproducing Jev's ideas from scratch: a parallel decision system with shared KV caches on Qwen3 1.5B
Sam_Witteveen · x · 2026-09-20
A developer reproduced ideas behind Jev from scratch, starting with a tiny Qwen3 1.5B model and building a parallel decision system using shared KV caches. They benchmarked sequential vs batched inference and achieved 100% decision agreement in cache correctness tests, sharing lessons in a thread.
More from coding & agent
- Grok Bots 1.0 leaks: multiplayer teammates, proactive agents in Slack and Teams — XFreeze · 2026-11-12
- Could MCP-powered copy-trading disrupt ETFs? Investor floats paying 0.5% for trade signals — MartinGTobias · 2026-11-12
- minpts-check: one-run predictor tells if your HDBSCAN clusters survive min_samples changes — leland_mcinnes · 2026-11-12
- Ten wild Gemini 4 Carbon demos in 24 hours: CUDA meadows, V8 engines, mech stomps — socialwithaayan · 2026-11-12
- How to cut Fable 5.2 token costs by 90%: Arc routing plus a lean CLAUDE.md — EXM7777 · 2026-11-12
- Hamel Husain's complete AI evals framework for PMs and engineers — aakashgupta · 2026-11-12