Question-first prompting took local Qwen from 89% to 100% and cut latency 5x
Micha0827 · reddit · 2026-09-21
A developer using local Qwen models for typed decisions (reading answer probabilities from logits in a single forward pass) found that flipping the prompt to question-and-answers-first, state-last boosted accuracy from 89% to 100% in English (89%→97% German) and cut median latency from 400ms to 80ms on 4-bit Qwen3.6-35B-A3B on an M2 Max over a 38-case benchmark. The speedup comes from the question block becoming a cacheable shared prefix; the accuracy gain is unexplained. Caveat: on long documents question-first still helped accuracy but was 6-8x slower since the doc can't be cached. Code and benchmark: github.com/Micha0827/snapjudge.
More from coding & agent
- User automates entire video clipping workflow with Nous Research's Hermes agent — Teknium · 2026-11-12
- As models improve, writing good evals gets harder and more important — amankhan · 2026-11-12
- Prime agent ships with day-one multi-agent communication, runs in Minecraft unmodified — sarahcat21 · 2026-11-12
- Autonomous agent edits just 1,024 weights to lift Qwen3.5 0.8B from 7.4% to 37.4% on MATH-500 — VictorSanh · 2026-11-12
- Omarchy 4.6 lets you share local AI models across your tailnet, says DHH — alexcovo_eth · 2026-11-12
- Coding harnesses hand shell access to inference providers — 4-step gateway mitigation — shensi · 2026-11-12