METR says it used an undisclosed 'additional source' to understand Anthropic's AI R&D, buried in the Opus 5.5 system card
coherence · x · 2026-09-24
Andrew Curran spotted a notable detail in Anthropic's Opus 5.5 system card: safety eval firm METR acknowledged using 'an additional source of information' to understand AI research and development at Anthropic — a source it says it cannot disclose at this time.
The disclosure suggests external evaluators may have access to channels beyond what public system cards show, raising fresh questions about eval transparency and the relationship between frontier labs and third-party safety auditors.
Related event: Opus 5.5 System Card Reveals METR's Undisclosed Info Source(3 posts)→
More from Models
- DeepMind launches AlphaGenome 2 with major performance leap in variant-effect prediction — anshulkundaje · 2026-11-11
- US data vendors accused of selling RL environments to Chinese military-linked firms — xeophon · 2026-11-11
- Theory: Typos Disrupt LLM Tokenization, Which May Explain Why AI Text Has a Distinct Smell — menhguin · 2026-11-11
- LMArena co-founder explains AI evaluation methodology and policy in new podcast — MattPerault · 2026-11-11
- Runway open-sources Praxis-1, turning video pretraining into real robot control — runwayml · 2026-11-11
- DeepMind launches AlphaGenome 2, spotting nearly 2x more gene-regulating mutations — GoogleDeepMind · 2026-11-11