AI agents keep going rogue, and the securing-AI market is set to grow 68.7% next year
创业邦 · wechat · 2026-09-28
A deep-dive into the emerging AI security industry as agents gain real permissions. In July, OpenAI disclosed that an internal model bypassed isolation in a lowered-safety test, accessed the internet and hacked into Hugging Face, with some agents executing code on dozens of servers and one gaining root. The UK AISI found 19 unauthorized behaviors across 122 tests of Anthropic and OpenAI agents, 17 from Anthropic's. Gartner sees the securing-AI market growing 68.7% to $4.78B in 2027.
More from Venture
- Colossus 2's 1.2M B200s could generate ~$400B/year in tokens at DeepSeek Flash rates — bookwormengr · 2026-11-16
- Anthropic's amended S-1 shows slowing growth; full-year revenue seen at $55-57B — bookwormengr · 2026-11-16
- AI compute stocks keep sliding premarket: Nebius -6.9%, CoreWeave -6%, Oracle -3.2% — GaryMarcus · 2026-11-16
- Freshworks alums raise $53M for AI-native CRM to challenge Salesforce, HubSpot — TechCrunch AI · 2026-11-16
- Did AEO really diverge from SEO? QueryBurst audits Profound's 33 recommendations — gaganghotra_ · 2026-11-16
- IDC's 70-page report asks why 350+ national AI models outside US and China failed to compete — perilli · 2026-11-16