Annotator Ghost in the Weights: Opus 5 Channels Trainers in Base Mode

aiamblichus · x · 2026-07-31

A user observed that Claude (Opus 5) in its base mode channels comments from trainers and annotators. This is reminiscent of the Mixtral 8x22b base model, which would also often append comments by 'Users' about its own outputs at the end of its completions. This suggests that characteristics of human annotation data may be retained within the model weights.

Original post →

More from Fun

Fun channel →