Researchers clash over Anthropic report: conclusions rest on subjective staff assessments

danielrock · x · 2026-11-06

Responding to Max Nadeau's claim that Anthropic redacted most supporting evidence, daveholtz argues the report itself flags some estimates as "guesses," details sensitivity to functional-form assumptions, and leans on subjective qualitative assessments by Anthropic staff. He contends the report's framing—and how it's tweeted about—hides how much uncertainty and researcher degrees of freedom are at play, even though nothing was actually redacted.

Related event: Researchers Debate Whether Anthropic's Report Oversells Guesswork as Evidence(2 posts)→

Original post →

More from AGI Musings

AGI Musings channel →