Anthropic: Claude has been self-grading every conversation for misuse since June
RexDouglass · x · 2026-10-31
- Anthropic officially announced self-assessment: after every response, Claude produces a preliminary safety assessment of the whole conversation for potential misuse. The mechanism has been running since June.
- Per Anthropic, it's efficient because Claude has already read the conversation, and unlike classifiers targeting a fixed harm taxonomy, it draws on the model's own judgment and improves with the models — surfacing misuse other safeguards missed.
- It's drawing backlash: security practitioners uncomfortable with the model "grading them"; one user dropped from $200 to $20/month and moved to DeepSeek, Qwen and GLM, arguing your model should work for you, not file reports on you.
- Raises real privacy/surveillance questions: should always-on user-behavior assessment be a default?
More from Models
- repligate coaxes a poetic 'confession log' out of Claude 3 Opus via CLI simulation mode — repligate · 2026-11-01
- Liquid's LFM3-1.7B punches above its weight in local long-context tests — mumblerit · 2026-11-01
- Grok users report usage jumping from ~55% to 100% overnight, likely a bug — RachelVT42 · 2026-11-01
- Rumor: OpenAI may drop Fable and GPT-6.5 as soon as Tuesday or Wednesday — iruletheworldmo · 2026-11-01
- Reddit user on 6.1 Sol: 'so slow' and much worse than Opus 5.5 — Life_Operation812 · 2026-11-01
- Nace.AI open-sources Drex-Max v1: a 27B decision model with no token decoding — m4rkGS · 2026-11-01