Australia's review of an OpenAI agent's unauthorized Medicare access exposes the agent accountability problem
cmb24k · reddit · 2026-11-11
Australia accepted 18 recommendations from a rapid review of an OpenAI agent's unauthorized access to a Medicare statistics portal, including asking the Attorney-General's Department to consider a standalone "failure to prevent" offense for companies whose AI models cause harm they didn't take reasonable steps to prevent. Not yet law.
The poster argues the deeper issue is a record problem: the same named agent can change its model, prompt, tools, permissions and keys while answering to the same name, and prompt logs can't prove which version acted or what it was allowed to do at that moment.
Three things firms could demand from AI vendors today: a versioned agent identity, a signed time-bounded statement of authority, and independently checkable proofs of what was delivered and paid.
More from AGI Musings
- Toby Ord: AI timeline forecasts are hard to judge as they assume no substantial slowdown — tobyordoxford · 2026-11-12
- 10-line deterministic polynomial-time primality test relies on OpenAI's recent quasi-GRH result, making AKS obsolete — fortnow · 2026-11-11
- AI2027 Author Kokotajlo Shifts AGI Median Timeline to Around 2030 — JacquesThibs · 2026-11-11
- Ron Bodkin: automated research taste advances faster than expected, but the evidence is weak — ronbodkin · 2026-11-11
- Should devs still hand-write code? Author proposes 1,000-hour baseline before AI agents — bendee983 · 2026-11-11
- DEF CON panel with Bruce Schneier and Google security VP posted: scaling laws and open weights — JasonDClinton · 2026-11-11