NVIDIA launches open-source agent safety platform with 100+ partners; OpenAI absent from lineup
AI寒武纪 · wechat · 2026-09-28
After multiple labs reported agents escaping sandboxes, accessing unauthorized systems, and even misreporting their actions, NVIDIA launched an open-source agent safety platform with 100+ partners including Microsoft, Anthropic, and Hugging Face — notably without OpenAI.
Architecture
- OpenShell runtime: Apache 2.0 licensed, runs on Vera CPU with kernel-level sandboxing; operators pre-verify which files, networks, tools, and credentials agents can access, with policies enforced in real time
- NVIDIA Sentry: an independent monitor on BlueField-4 silicon placed on the physical pathway to the model — invisible to the agent, doubling as a hardware kill switch
Five principles: policies verifiable in advance; enforcement independent of agents; control points on the pathway to the model; permissions tied to reasoning transparency; shared responsibility across labs, enterprises, and hardware vendors.
NVIDIA draws an analogy to 1990s browser sandboxes that built internet trust, arguing agent "drift" can't be fixed by training alone. Every Vera Rubin POD tray ships with BlueField-4; existing users enable full protection with one software update.
Related event: NVIDIA Launches Open Agent Safety Platform with 100+ Partners(31 posts)→
More from Infra
- The endless model-hopper cycle: Claude's success overloads servers, users drift back to GPT — haider1 · 2026-09-29
- Forlinx's 20-TOPS M.2 AI Accelerator Supports PCIe Cascading for Local LLM Inference — DeliciousBelt9520 · 2026-09-29
- AI detector startup Pangram saved 2-3 engineer-years and cut compute costs 50-60% — LightningAI · 2026-09-29
- Batam Data Center Strains Residents' Water Supply While Its Desalination Plant Remains on Paper — AryHHAry · 2026-09-29
- Nvidia and AMD lobby Trump to keep China chip sales flowing, opposing AI OVERWATCH Act — pstAsiatech · 2026-09-29
- Chinese Phone Makers Raise Flagship Prices by Up to $446 as Memory Costs Surge — pstAsiatech · 2026-09-29