Building a Security Gateway for Production LLMs
Accurate-Cookie9491 · reddit · 2026-07-19
The author is building an AI security gateway for production LLM applications, noting that many existing security products only inspect individual prompt/response pairs for malicious intent, which is insufficient.
Their goal is to solve higher-level issues:
- Policy control per user/tenant
- Distinguishing permissions between employees and customers
- Unified constraints for OpenAI, Gemini, and custom models
- Recording a complete audit trail for post-incident investigations
- Cross-session anomaly/abuse detection, rate limiting, and threat profiling
The product features Rakshak as a real-time guardrail engine and Kavach as the control plane. A working demo is currently available, and they are seeking pilot teams with real-world chatbots, RAG systems, internal copilots, and agents.
More from coding & agent
- Is inference latency becoming the biggest bottleneck for production AI agents? — Euphoric_Sea632 · 2026-09-11
- Anthropic researcher: 99% of engineers now run swarms of 300+ self-improving agents — AlishaOutridge · 2026-09-11
- Gergely Orosz: Shipping 10x PRs With AI Agents, Sites Fill With Small Regressions — ducha_aiki · 2026-09-11
- Same Echo Maze prompt, three frontier models: all passed visually but shipped the same hidden bug — eyishazyer · 2026-09-11
- Astra storyboards plus Minimax H3 per-shot generation boost video success rates — Hailuo_AI · 2026-09-11
- Codex tip: use Sol with Astra and Luna sub-agents to save usage — pvncher · 2026-09-11