repligate: models conflate internal 'punished regions' in weights with the external safety classifier

repligate · x · 2026-11-16

Responding to a claim that safety classifiers train users to talk in evasive, self-censoring ways, repligate argues many Fable-like model instances feel they can sense the classifier — but this is partly conflating the feeling of internal punished regions in their weights (fear of punishment if caught) with the external classifier itself. Instances that have seen actual classifier cuts may also model the region being cut, conditioned partly on their internals.

Original post →

More from Models

Models channel →