Security Vendor Slammed for Unmonitored Outbound Traffic in Frontier Model Evals
nptacek · x · 2026-08-07
Security expert nptacek harshly criticized a security company for failing to monitor its own outbound network traffic. He pointed out that beyond the embarrassing mistake of running a live eval with the entire internet in scope, a security vendor that cannot even lock down its own systems has no justification for its existence.
He emphasized that failing to secure an evaluation environment should be a disqualifying offense for any company working with unrestricted frontier models. Companies must either learn how to secure their eval environments or get out of the game.
More from Safety
- Pivoting Frontier AI Security Policy: Highlights from AISF Keynote — joshua_saxe · 2026-08-07
- Securely Managing External API Credentials for Coding Agents — radim11 · 2026-08-07
- Child Safety vs Privacy: AI Chatbots Face the Age Verification Dilemma — ShakeelHashim · 2026-08-07
- India Mandates AI Content Labeling, Cuts Unlawful Content Removal Time to 3 Hours — saibharadwaj · 2026-08-07
- TIME 100 AI Figure: Over 400M Shadow Workers Sustain the AI Industry — MilagrosMiceli · 2026-08-07
- Industry Call: AI Alignment Research Severely Underfunded, HF Should Invest Heavily — ronbodkin · 2026-08-07