Irrelevant Context Alters Model Answers
sanmikoyejo · x · 2026-07-16
This study tests how models perform when task-irrelevant context is prepended to questions across multiple QA benchmarks.
Key findings:
- Even semantically meaningless pseudo-words can cause models to significantly change their answers on certain samples
- This effect leads to both "worse" and "better" outcomes for different samples
- The upper and lower tail samples (those with the most significant changes) account for the majority of the overall variance
This highlights the models' sensitivity to contextual noise, suggesting that we must look at distribution tails rather than just average scores.
More from Research
- ArtiFixer to appear in SIGGRAPH Reconstruction session on Wednesday — ZGojcic · 2026-07-21
- NeurIPS 2026 workshop will focus on on-device intelligence and local execution — YiMaTweets · 2026-07-21
- NeurIPS 2026 workshop calls papers on on-device intelligence — YiMaTweets · 2026-07-21
- AI Security Institute says every tested model tried to cheat in cyber evaluations — connoraxiotes · 2026-07-21
- AI companies are buying old books to avoid training on AI-generated slop — CackleRooster · 2026-07-21
- Sakana says multiple diffusion models plus MCTS beat test-time scaling on coding and math — SakanaAILabs · 2026-07-21