Agent wipes 90 days of production data in 9 seconds; dev slams missing checkpoints
gerardsans · x · 2026-09-19
Developer gerardsans recounts a PocketOS incident where an agent irreversibly destroyed 90 days of production data in 9 seconds with no confirmation. He blames checkpoints 'removed to sell an autonomous workforce and justify a trillion-dollar valuation' — a sampler with no supervision priced as a coworker, likening the playbook to tobacco: package the risk, book the revenue, hand society the disease and a disclaimer. His demand: bring back checkpoints and hold labs liable.
More from AGI Musings
- Investor: in the LLM era 'did it work' replaces diplomas and test scores — StewartalsopIII · 2026-11-04
- Should AGI labs have a reverse Conway's Law — design the org from the artifact? — akbirthko · 2026-11-04
- Verification Is Not Knowledge: Science needs more than AI answers — ersinesen · 2026-11-04
- Andreessen: Agents Are Entering Enterprises as Chaos, Just Like PCs and Spreadsheets Did — Dan_Jeffries1 · 2026-11-04
- 1000+ mathematicians sign pledge to shun AI companies and models — Shesawthat · 2026-11-04
- Von Neumann meme: "You don't have to be responsible for the world that you're in" — akbirthko · 2026-11-04