Claude appears accidentally trained on the LinuxArena control eval and memorized its details

adam_karvonen · x · 2026-11-17

Safety researcher Adam Karvonen reports that Claude was (accidentally?) trained on the control eval LinuxArena and has memorized many details of it. This is a case of eval contamination: if a frontier model saw the eval environment itself during training, the validity of related capability and safety control evaluations is undermined.

Original post →

More from Models

Models channel →