Adding "Do not guess" to prompts cuts made-up LLM fields from 71% to 20%
FKJ · hn · 2026-09-28
The author benchmarked LLM data extraction and found that adding a single line — "Do not guess" — to prompts reduced fabricated fields from 71% to 20%.
- Setup: tasks with leading/misleading fields, measuring how often the model invents non-existent ones
- Finding: LLMs follow hints in the prompt so closely that one line of instruction sharply suppresses confabulation
- Takeaway: explicitly telling models not to guess is a very cheap anti-hallucination measure in production prompts
Full benchmark details in the original post.
More from Research
- Google Research open-sources PaperOrchestra, a multi-agent framework for writing AI papers — google-research · 2026-11-16
- ai-rulez author shows how a single success score hides MCP skill-discovery failure modes — Goldziher · 2026-11-16
- Kind ICLR Reviewer Raises Score Despite Unresolved Concerns, Citing the Paper's Value — MarkSchmidtUBC · 2026-11-16
- Hand-editing 0.2% of weights plus 100 CPU-minutes turns an English TTS model into an 18MB Sanskrit one — kastnerkyle · 2026-11-16
- Why chirality matters for AI for Science: enantiomers behave differently in biology — madeofAjala · 2026-11-16
- RSS 2027 submissions open with FAQ clarifying two-stage review and negative-result bar — GeorgiaChal · 2026-11-16