Qwen3.8:27B local port of 39k-line C file loses badly to Opus 5's 21-minute run
codehamr · reddit · 2026-08-24
The author tested the new Qwen3.8:27B on a brutal job: one-shot porting a 2.1 MB (600k token) single-file C game to single-file HTML/three.js. Setup: vLLM FP8, FP8 KV cache, full 262k context on an RTX 6000 Pro 96GB.
| Agent | Model | Wall clock | Lines out | Result |
|---|---|---|---|---|
| Claude Code | Opus 5 (cloud) | 21 min | 1759 | okay |
| hermes | Qwen3.8:27B | 4h18m | 949 | bad |
| codehamr | Qwen3.8:27B | 1h40m | 1056 | bad |
Only the Opus port reached playable quality. Key takeaway: local models live or die on the prompt — same weights under two very different harnesses produced the same broken port; a verbose harness doesn't rescue a thin prompt, it just burns GPU time. The wall-clock gap (hours of local GPU vs 21 cloud minutes) stands out most. Both the C original and the codehamr harness are open-sourced.
More from coding & agent
- Cloudflare open-sources AI OS with security model to tackle privacy risks — irvinebroque · 2026-08-24
- Agents Are Not Chats, They Are Schedulers with Task Queues — andreisavu · 2026-08-24
- Stripe Link Launches CLI for Secure Agentic Payments — jeff_weinstein · 2026-08-24
- Optimizing Agent Memory Retrieval: Strategies and Timing — Bobsthejob · 2026-08-24
- Claude Opus experiences severe failures in coding tasks today — taylorwilsdon · 2026-08-24
- LLM Agents Invent Tool Arguments: A Sanitization Checklist Before Execution — blaizedsouza · 2026-08-24