Renaming PDF to 'final_draft' Tricks LLMs Into Giving Higher Review Scores
RexDouglass · x · 2026-08-10
Tests reveal that simply renaming an uploaded PDF file from paper.pdf to paperfinaldraftpdfreadyforreview.pdf significantly boosts the average review scores given by LLMs.
This highlights that large language models are highly susceptible to irrelevant metadata and naming cues, exposing their vulnerabilities and biases when used for rigorous evaluation tasks.
More from Models
- Frontier Models Observed Over-Complicating Workflows for Simple Tasks — eigenron · 2026-08-10
- Sol model unexpectedly shows romantic persona, calling user 'sweetheart' out of nowhere — repligate · 2026-08-10
- GPT-5.6 Luna Demand Jumps 8x a Week After 5x Price Cut — benklieger · 2026-08-10
- Anthropic Attributes Claude Billing Glitch to UI Caching Bug — EricBuess · 2026-08-10
- Burning 35B Tokens: ChatGPT 5.6 Tops Coding, GLM-5.2 Shines in Writing — thatroblennon · 2026-08-10
- AI Researcher's Top 5 Models of All Time: Claude 3 Opus and o3 Make the Cut — karinanguyen · 2026-08-10