Self-hosted daily game pipeline runs Qwen3.6-35B and Qwen-Image locally on DGX Spark, zero API fees
jbsan · reddit · 2026-11-16
A Redditor built itsisekai.com—a daily guessing game where famous movies/games are rewritten as overlong isekai light-novel titles—powered entirely by a local NVIDIA DGX Spark (GB10, 121GB unified memory) acting as a self-hosted GitHub Actions runner, with zero API costs.
Stack: Qwen3.6-35B-A3B official FP8 via vLLM (fp8 KV cache, 128K context, MTP speculative decoding with 3 draft tokens, prefix caching, gpu-memory-utilization dropped to 0.45 so ComfyUI fits beside it), 70 tok/s typical, 240 tok/s peak. Images via Qwen-Image in ComfyUI (fp8 weights, 832x1248, 20 steps, cfg 2.5), 64s per render.
Pipeline: titles are written first so later quests can see earlier answers; an "how obvious is this title?" check triggers rewrites; covers are judged by the same vision model—if it can name the work, the prompt gets more abstract and redraws up to 3 times, else the cover stays sealed. A Nov 15 production run (8 quests) took 61m29s; 4 of 8 titles were rewritten as too obvious, 8/10 cover attempts passed.
Pitfalls: vLLM guided JSON jams with Qwen thinking mode—parse JSON from replies instead; set presencepenalty 1.5 to stop circular thinking; retry per-call failures instead of wiping a whole day; don't overlap manual runs with the nightly cron.
More from coding & agent
- Grok Build v1.0.87 improves multi-agent workflows, MCP panel and session search — XFreeze · 2026-11-16
- AgentWeb lands YC W27 spot building endpoints that let AI agents operate any site — damnGruz · 2026-11-16
- Prototype pairs kids' code, a real robot and Snap Spectacles AR for learning — stspanho · 2026-11-16
- Agents need throwaway DB copies, not mocks — copy-on-write cloning may become default infra — petrusenko_max · 2026-11-16
- ArkenOS dev bets swarms beat agent trees, now handling billions of tokens daily — _AustinCalvert_ · 2026-11-16
- Solving "hallucinated commitment" in agent-to-agent negotiation with three-layer guardrails — firdo_dev · 2026-11-16