Jensen Huang on AI safety: contain agents, monitor them in real time with BlueField chip
XFreeze · x · 2026-09-30
Jensen Huang laid out NVIDIA's approach to keeping AI safe: models are relatively safe during training, but evaluation and testing require a highly secure containment system for the agentic stack — and you should never assume containment holds, so monitoring must run in real time on separate hardware outside the agent's sandbox. The same containment-plus-monitoring model applies after deployment, analogous to onboarding a new employee with limited rights and continuous oversight. NVIDIA introduced two technologies for this: OpenShell, a containment system described as "a browser for agents" that isolates the agent from the rest of the computer with minimal permissions, and BlueField, a chip that watches everything the agent does and escalates on out-of-bounds behavior. Huang argued safety and advancing the technology are "one and the same thing," dismissing capability-vs-safety tradeoffs as a false choice.
More from Infra
- Mobile AI Factory: agents auto-build on-device SLMs with 19x less GPU time — pmttyji · 2026-11-16
- Stratechery's Fictional Obituary: Imagining Jensen Huang's 2026 Exit From Nvidia — Gregory_C_Allen · 2026-11-16
- vLLM serves DeepSeek V4.1-Flash at 954K tokens/s per GPU, $38.96/GPU-hour on GB300 NVL72 — bookwormengr · 2026-11-16
- Colossus 2's 1.2M B200s could generate ~$400B/year in tokens at DeepSeek Flash rates — bookwormengr · 2026-11-16
- BIS issues rule blocking remote access to US AI chips via third-country data centers — teortaxesTex · 2026-11-16
- Qdrant 1.20.1: 50% fewer cold-storage reads, ~2x faster quantization, agent-ready setup — qdrant_engine · 2026-11-16