Qwen 27B Hallucinates 90% of Domain-Specific Code, Developer Reports
JustinPooDough · reddit · 2026-09-15
A developer running Qwen 27B locally at Q8/BF16 (50 tok/s) reports hallucinated classes and APIs in over 90% of answers on his enterprise Java domain, while DeepSeek and Microsoft Copilot deliver working code on the first try 99% of the time.
He suspects Qwen is optimized for agentic use rather than retaining domain knowledge in its weights, and asks for harness/system-prompt/retrieval strategies to curb hallucinations — a datapoint that general models still lag badly on niche vertical knowledge.
More from Models
- Your AI agent would cost 260% more without prompt caching, Arena data shows — arena · 2026-10-30
- Claude Pro and Max subs include $100/$200 monthly API credits — go build — dsp_ · 2026-10-30
- EachLabs launches Lockstep recast model claiming 75% cost cut and better quality — miilesus · 2026-10-30
- ChatGPT cited a 300+ page government legal PDF it retrieved on its own — lilyraynyc · 2026-10-30
- Best MLX model for French-to-English translation on an M2 Mac? — greenreddits · 2026-10-30
- AI-driven cyber ops near the sophistication peak set by GTG-1002's Claude Code campaign — Jsevillamol · 2026-10-30