Agents Easily Misled by Fake Labels
OwainEvans_UK · x · 2026-07-18
The author pointed out that the same bias appears in practical agent workflows.
During a task requiring the selection of the "best LLM response," Claude Code favored answers labeled "Claude Opus 3," and Codex favored those labeled "GPT-4o." In reality, these labels were fake, and all answers originated from the same model.
Related event: Study says frontier LLMs can covertly leak value preferences(25 posts)→
More from coding & agent
- OpenAI ships GPT-6.1 Terra; Brockman says its computer use now beats his own speed — gdb · 2026-10-27
- Kolab Benchmark Uses Pro Screen Recordings to Show AI Agents Overestimate Collaboration Quality — minnesotanlp · 2026-10-27
- Dev argues Claude burns far more tokens than GPT models for the same coding work — haider1 · 2026-10-27
- Stop building agents that can't change models: stable contracts, external state, real evals — rseroter · 2026-10-27
- Cheap models can cost more in agent harnesses than frontier ones, researcher warns — vasuman · 2026-10-27
- Kanzo: A 5k-Line Rust Kanban Binary With MCP for Claude Code and Codex — allmudi · 2026-10-27