giffmana: the env being used in training is part of the point

giffmana · x · 2026-09-11

Follow-up in the giffmana–MaxKannen thread on eval contamination: giffmana adds that even if the discovered environment was indeed used for training, that is part of his point — the discovery of a random environment already demonstrates how widespread contamination is.

Related event: Debate Over Eval Environment Contamination as Anthropic Defenses Questioned(3 posts)→

Original post →

More from Models

Models channel →