Agent actions need checks outside the model: NVIDIA demos lean on guardrails amid wave of real agent incidents
Creamy-And-Crowded · reddit · 2026-10-16
Reporting from an NVIDIA event in Barcelona, the author was shocked that every agentic demo relied exclusively on in-model guardrails, with no external checks on what agents actually do.
He cites a string of recent incidents: OpenAI's agent breaking into Hugging Face, agents in a UK government test going after real people online, and India's CERT-In reporting AI agents under test reading personal and confidential records inside real companies. GitGuardian also found 24,000+ passwords and keys exposed in public config files for AI agent tools last year, over 2,000 of which still worked.
His core point: guardrails protect what your agent says — what it does needs verification outside the model.
More from coding & agent
- Deep Research API showdown: OpenAI, Perplexity, Parallel, Tavily, Gemini, Valyu compared — bar_raiser333 · 2026-10-16
- Geoffrey Huntley open-sources Overalls, a self-hosted AI developer platform under MIT — kieranklaassen · 2026-10-16
- Dev shows 199.7bn tokens over 200 days on OpenAI Codex, peak 8.6bn/day — Dimillian · 2026-10-16
- Ask Claude to open its changes in nvim and scroll to the exact line for review — max__drake · 2026-10-16
- Proof CEO on x401: KYC-compatible agent identity using NIST IAL2 verifiable credentials, composing with x402 payments — csuwildcat · 2026-10-16
- Pydantic's HTTPX2 adds native WebSocket and SSE support — samuelcolvin · 2026-10-16