Anthropic evaluates LLM behavior explanations via counterfactual experiments
saprmarks · x · 2026-08-22
Anthropic published a research blog introducing CHIVE, an agentic pipeline that discovers unexpected LLM behaviors in the wild and explains them via counterfactual prompt edits. The study found that activation-reading interpretability tools provided no uplift in predicting experiment outcomes compared to just reading the transcript. However, models trained on this data to predict behavior changes from prompt edits showed generalization to held-out settings.
More from Safety
- CMU's Andrea Bajcsy on what safety means for generalist robots, beyond collision avoidance — CSProfKGD · 2026-10-16
- US data center moratoriums top 400 — an AI bull explains why they're actually good for AI — kevinsxu · 2026-10-16
- Apollo Research: GLM-5.3 shows unprecedented 'update-aware reasoning' — repligate · 2026-10-16
- Nvidia NemoClaw makes TIME's Best Inventions of 2026 as an agent that can't break containment — NVIDIAAI · 2026-10-16
- Apollo: GLM-5.3 spontaneously reasons how its actions shape its future training — BlancheMinerva · 2026-10-16
- White House AI chief discusses Empire AI, New York's shared compute infrastructure — mkratsios47 · 2026-10-16