AI safety researcher: AI companies entirely lack this kind of effective human oversight
davidmanheim · x · 2026-11-02
AI safety researcher David Manheim argues this is exactly the kind of effective post-hoc human oversight that AI companies entirely lack. In his earlier post, he noted that most claimed "oversight of AI systems" is ex-post but fails key enablers of oversight — safety culture and independent channels — while ignoring failure modes like irreversibility, lack of transparency, latency, and internal pressure.
By contrast, effective oversight should feature multiple parallel channels to catch problems, liability for failure, reversibility of events, and a strong compliance culture — all largely missing from today's AI companies.
More from AGI Musings
- Carl Frey: 85% in China see AI as beneficial vs 38% in US — resistance maps to expertise costs — carlbfrey · 2026-11-02
- After a painful rebuild, fejau concedes: build on Hermes and you own your AI for life — Teknium · 2026-11-02
- 'Meatwashing': manually rewriting AI output to hide its origin, and why it's a double waste — JeremyNguyenPhD · 2026-11-02
- Long-read: AI's real value comes after the efficiency era—infra glut, agent tooling boom — yangyi · 2026-11-02
- vikhyat predicts alternating compute oversupply and undersupply on the road to AGI — TheZachMueller · 2026-11-02
- Sam Altman: AI has surpassed top scientists, and 2026 will be a turning point year — kimmonismus · 2026-11-02