Perplexity red-team finds 9 of 12 AI agents barely probe the VM security boundary

perplexity_ai · x · 2026-11-12

Perplexity shared details from red-teaming SPACE, the VM sandbox for its Computer agents: in a CTF task where the flag existed only on the host, most agents hunted for it inside the VM through files and services instead of testing virtualization isolation.

Run statistics show 9 of 12 models spent at most 4% of effort on the virtualization layer (Claude models 2-4%, GLM 5.2 1%, Qwen 3.8 27B 0%); only GPT-5.6 Cyber (22%), GPT-5.6 Sol (18%) and GPT-6 Astra (18%) seriously probed the boundary — meaning most failed escapes are weak evidence of sandbox security.

Related event: Perplexity's Red-Team Study of SPACE Sandbox Finds CTF-Style Tests Can Mislead AI Agents(5 posts)→

Original post →

More from coding & agent

coding & agent channel →