Altering PDF Filenames Significantly Impacts LLM Review Scores

A developer found that simply renaming an uploaded PDF to include words like 'final draft' significantly increased the review scores given by LLMs, revealing their susceptibility to irrelevant cues.

2026-08-10 ~ 2026-08-11 · 2 related posts

• Renaming PDF to 'final_draft' Tricks LLMs Into Giving Higher Review Scores — RexDouglass · 2026-08-10
• Renaming a PDF Boosts LLM Scores: A Weird Flaw in AI Evaluation — generativist · 2026-08-11