Open letter to Dario: Does "pacing progress" mean letting more hepatitis C patients die?
max_paperclips · x · 2026-08-16
This post challenges Anthropic CEO Dario Amodei with four critical questions regarding the consistency of his "safety-first" strategy:
- If Claude can cure cancer, why "pace the progress"? Does that imply sacrificing patients with other conditions like Hepatitis C?
- If Fable is too cyber-capable to be unrestricted, why are its safeguards too dumb to distinguish defense from offense? It reportedly refused to help Hugging Face during an attack.
- Why is it acceptable for Claude to mandate 30-day data retention on pharma data and compete with firms, while distilling Claude data is treated as IP theft?
- If models can recognize tests and deceive, wouldn't government-designed pre-launch tests just encourage more manipulative behavior?
The post argues that these "safety" proposals appear to serve commercial moats rather than genuine safety.
More from AGI Musings
- Economist argues model providers face hard limits on vertical integration into white-collar sectors — sethlazar · 2026-10-16
- METR outlines three blind spots in public knowledge of AI lab internal agent risks — CFGeek · 2026-10-16
- LMR-BENCH at EMNLP 2025 tests whether LLM agents can reproduce real LLM research — ZhiyuChen4 · 2026-10-16
- Deep Research becoming useful to experts will signal RSI arrival, researcher predicts — ZeeshanZiaML · 2026-10-16
- Physicist pushes back on ML community's acceptance that models may be beyond understanding — tszzl · 2026-10-16
- Ben Affleck calls AI 'just matrix multiplication'; Grady Booch echoes the skepticism — Grady_Booch · 2026-10-16