Villager sim game built locally on 16GB VRAM with Qwen3.8-27B Q3 quant at 75 tok/s
Fancy-Snow7 · reddit · 2026-09-06
A dev built a playable villager simulation game POC with Qwen3.8-27B-UD-Q3KXL.gguf fully offloaded on a 16GB RTX 5070 Ti, hitting up to 75 t/s generation and 1700 t/s prefill with 96k context on Windows. Key lessons: don't fear Q3 quants or KV quantisation — a higher quant forcing CPU offload drops speed to 5-20 t/s, while high speed lets you fix issues with follow-up prompts; MTP/draft caches can now be quantised with kvarn, saving VRAM versus qxx quants. Development was incremental feature prompts rather than one-shot, with minimal hints (modular code, no magic numbers) and almost no code reading. Context overflow was managed with handover documents and the pi-observational-memory extension. Features include a large scrollable map, minimap, weather/seasons, day-night cycle, resource storage, houses, and death from hunger or cold.
More from coding & agent
- Running Qwen 3.8 27B Locally to Drive Blender via MCP and Build a 3D Llama — jacek2023 · 2026-09-06
- tokenbender's trick: ask the model for two prose narratives to detect long-task drift — tokenbender · 2026-09-06
- KV cache pressure tool shows vLLM's advertised 2M-token cache can retain 3M after fixes — t4a8945 · 2026-09-06
- Nous Research ships Hermes BOT MODE for building multi-agent AI teams — Teknium · 2026-09-06
- User says GPT-6-Astra built 33 analytics insights and 3 dashboards in 30 minutes — Scobleizer · 2026-09-06
- Student Open-Sources MCP Gateway That Cuts Token Use 50% With Vector-Indexed Tool Catalog — randomdick_18 · 2026-09-06