Miles Brundage warns that the AI industry has a growing over-trust problem
Miles_Brundage · x · 2026-07-25
Miles Brundage says the concern is broader than Anthropic alone: the industry has an underappreciated over-trust problem.
- He argues this is likely even more dangerous at companies with faster capability gains and stronger pressure to dogfood their own models.
- The reply frames the issue as an industry-wide safety concern, not just a one-off chart controversy.
- The main point is that over-reliance on model outputs is becoming more dangerous in real-world settings.
Related event: Ex-Researcher Says Anthropic Chart Controversy Stems from Overtrust in AI(4 posts)→
More from AGI Musings
- Gary Marcus says China has mostly caught up in AI, especially on price — bookwormengr · 2026-07-25
- An AI reviewer may already beat most NeurIPS reviews, says VitalyFM — vitalyFM · 2026-07-25
- Third-party labs are needed to verify frontier AI safety claims — teortaxesTex · 2026-07-25
- MIT Sloan says AI can expand worker capability, not just automate jobs — Exp_Mark · 2026-07-25
- A Reddit post warns that unfiltered AI may be moving faster than society can absorb it — DoctorHoliday3942 · 2026-07-25
- Flock camera networks raise privacy, error, and data-use concerns — DavidLinthicum · 2026-07-25