Snyk says agent security needs a deterministic validator, not another model
AI Engineer · youtube · 2026-07-21
Snyk's Manoj Nair argues that secure agentic development needs a deterministic validator, because the same LLM is not reliable as both generator and checker.
- In their tests, asking frontier models to find the same vulnerability five times caught it only about half the time, while a deterministic checker reached at most 75% of issues and a 40% F1 score.
- Across 4,800 customers, Snyk saw security backlog grow 108% quarter over quarter, as code generation outpaced remediation.
- A public audit of nearly 4,000 agent skills found more than one in eight had critical issues and 76 carried outright malicious payloads.
- The talk also flags MCP servers and poisoned skills as a new supply-chain risk, and shows why verification must stay outside the probabilistic loop.
Related event: Snyk: Agent Security Requires Deterministic Verification(2 posts)→
More from coding & agent
- Claude Code + Monid MCP builds a $12K/year B2B prospecting engine on live data — aryanXmahajan · 2026-10-26
- Karpathy shares CLAUDE.md rulebook to stop AI coding agents from piling up tech debt — mdancho84 · 2026-10-26
- Rethinking dependencies in the agent era: drop libs that save 20 lines of code — gethackteam · 2026-10-26
- RustGIS hits 2,000 GitHub stars in two weeks with agent-first architecture — giswqs · 2026-10-26
- Vercel Ships 12 New Products at Its 2026 Conference as It Races Rivals for the Agent Entry Point — FinanceYF5 · 2026-10-26
- Build an AI agent from scratch in under 50 lines of pure Python: ReAct loop tutorial — adnan_hashmi · 2026-10-26