Question-first prompting took local Qwen from 89% to 100% and cut latency 5x
Micha0827 · reddit · 2026-09-21
A developer using local Qwen models for typed decisions (reading answer probabilities from logits in a single forward pass) found that flipping the prompt to question-and-answers-first, state-last boosted accuracy from 89% to 100% in English (89%→97% German) and cut median latency from 400ms to 80ms on 4-bit Qwen3.6-35B-A3B on an M2 Max over a 38-case benchmark. The speedup comes from the question block becoming a cacheable shared prefix; the accuracy gain is unexplained. Caveat: on long documents question-first still helped accuracy but was 6-8x slower since the doc can't be cached. Code and benchmark: github.com/Micha0827/snapjudge.
More from coding & agent
- Google open-sources AX, an agentic orchestrator likened to Kubernetes for agent executions — arpit_bhayani · 2026-09-21
- Watching Claude use a Charuco board to estimate product dimensions from a photo and model it in OpenSCAD — _Stocko_ · 2026-09-21
- AI intern cuts job boot time ~60%, saving ~5 CPU-days per day — DanielLockyer · 2026-09-21
- Anthropic engineer demos 22-minute async Claude Code workflow that runs unattended — anthara_ai · 2026-09-21
- Would coding agents do fine with just bash? Benchmarking without read/write/edit tools — lucasmeijer · 2026-09-21
- StepFun's Step 5 Preview early tests: Pareto frontier on cost vs. capability — StepFun_ai · 2026-09-21