Agents lack basic safety mechanisms and are 'vibe coded' blackboxes, posing deployment risks
gerardsans · x · 2026-08-25
Gerard Sans notes that while LLMs follow instructions, current agents lack essential safety mechanisms like authentication, authorization, and monitoring. Labs skip safeguards due to cost, relying on "vibe coded" natural language instructions that create unpredictable, un-debuggable blackboxes. He questions why such systems are being deployed in corporate environments given these obvious risks.
Related event: AI safety debate: the real threat is bad engineering, not rogue models(5 posts)→
More from Safety
- Senate set to give staffers access to Anthropic's Claude, Bloomberg reports — ShakeelHashim · 2026-10-16
- FDA pays small company to build a grading system for AI-written radiology reports — YvesMulkers · 2026-10-16
- OpenAI tells US judiciary there may be no reliable way to detect AI-generated images and videos — Polymarket · 2026-10-16
- Gartner: 75% of organizations have seen unauthorized use of AI coding assistants — moniquejmorrow · 2026-10-16
- [un]prompted conference to stage three AI security debates on vulns, defenses, jailbreaks — WeldPond · 2026-10-16
- User Questions AI Chat Logs Being Instantly Copied to Governments and Firms — Turn_Trout · 2026-10-16