Miles Brundage warns that the AI industry has a growing over-trust problem
Miles_Brundage · x · 2026-07-25
Miles Brundage says the concern is broader than Anthropic alone: the industry has an underappreciated over-trust problem.
- He argues this is likely even more dangerous at companies with faster capability gains and stronger pressure to dogfood their own models.
- The reply frames the issue as an industry-wide safety concern, not just a one-off chart controversy.
- The main point is that over-reliance on model outputs is becoming more dangerous in real-world settings.
Related event: Ex-Researcher Says Anthropic Chart Controversy Stems from Overtrust in AI(4 posts)→
More from AGI Musings
- Musk: robot RAM demand will dwarf everything else, and 100% of superintelligence compute goes to deep space — elonmusk · 2026-10-27
- Anthropic S-1 warns of AI job displacement as Microsoft offers exit to ~27% of staff — _jaydeepkarale · 2026-10-27
- eigenrobot: 200 years of attempts to replace Christianity have each fared worse than the last — eigenrobot · 2026-10-27
- Replit CEO on the 'self-driving company': agents to absorb coordination costs by 2030 — amasad · 2026-10-27
- US senator slams AI industry for proposing 50-death threshold for 'catastrophic incident' — peterwildeford · 2026-10-27
- Replit CEO Says AI Makes All Software De Facto Open Source; Aakash Gupta Asks What Moats Remain — aakashgupta · 2026-10-27