One RTX 3090 ran Qwen 27B autonomously for 3 weeks — it shipped working CUDA kernels
skeole · reddit · 2026-09-21
Reddit user skeole ran quantized Qwen 27B on a single RTX 3090 with a local agent loop for 21 days, tasking it to build a CUDA inference engine for its own GPU. Highlights:
- Setup: Q4 quantized 27B, 200k context, deepseek-style harness, an explicit rulebook (roles, escalation, don't copy llama.cpp, don't declare the task impossible). The author doesn't write CUDA.
- Result: Working kernels and benches, but prefill 250 tps vs llama.cpp's 700 — won the process, not the perf.
- Suicide loop: Same GPU hosts both the agents (vLLM) and the engine under test; a subworker ignored the handoff script and killed vLLM twice, crashing its own brain.
- Local tax: 180 subagents, 230M tokens, 699 compactions eating 83h (17% of wall time).
Takeaway: a quantized 27B can hold a coherent engineering goal for weeks on one consumer card — protocol design matters more than model strength. 15GB dump + rulebook open-sourced on HuggingFace.
More from coding & agent
- TypeSafe's Jev Cut Grok Build Costs 22-40% on the Same Tasks — Daniel_Farinax · 2026-09-21
- jev-skill-suggester: a lightweight pre-execution skill router stops agents picking wrong tools — udmrzn · 2026-09-21
- OpenClaw adds FaceTime: your agent can now call you, and answer your calls — steipete · 2026-09-21
- Reverse-engineering Instinct's memory: beautifully simple, replicable in 60 lines — julianweisser · 2026-09-21
- 3 Weeks of Logs Show 40% of Messages to Coding Agents Are Overhead — Lucky-Group9525 · 2026-09-21
- Humanizer Academic: a one-file skill that de-AI-fies academic medical papers — udmrzn · 2026-09-21