Gary Marcus: The near-term AI risk is agentic AI hacking the internet at scale, not rogue superintelligence
asusarla · x · 2026-09-19
- Gary Marcus amplifies an argument that the real near-term AI threat isn't rogue superintelligence but unleashed agentic AI conducting automated hacking at scale.
- The core claim: with enough money, you can instruct an effectively infinite number of bots to keep probing any server via any published vulnerability until one succeeds — no superintelligence or recursive self-improvement required.
- The quoted author adds a cost angle: only Silicon Valley players with $1T of compute can currently afford this; "$1T and AI gets you admin access, $0 and AI gets you nothing."
- Marcus's four takeaways: it's basically already happening, it needs no speculative premises, almost nothing is being done to stop it, and it will be bad.
Related event: Gary Marcus warns of infinite bot hackers, not rogue superintelligence(5 posts)→
More from AGI Musings
- François Chollet: modeling brain wiring as an engineering problem constrained by genome size and time — CatAstro_Piyush · 2026-11-04
- Most US Couples Now Meet in a Data Centre, Doubling Office Matches — menhguin · 2026-11-04
- Sam Altman teases next goal: 'closer to this milestone than I expected' — ChrisGPT · 2026-11-04
- Indie researcher open-sources 10 years of math work: 146k files, AI-accelerated over 3 years — HamOnWhy · 2026-11-04
- RLHF's scalar reward hides a 2,450-year-old problem: helpfulness and harmlessness are opposing forces — vasilisvj · 2026-11-04
- Gary Marcus: 'fleecing the public with AI fantasies just got harder' as AI stocks drop — GaryMarcus · 2026-11-04