Building a Security Gateway for Production LLMs
Accurate-Cookie9491 · reddit · 2026-07-19
The author is building an AI security gateway for production LLM applications, noting that many existing security products only inspect individual prompt/response pairs for malicious intent, which is insufficient.
Their goal is to solve higher-level issues:
- Policy control per user/tenant
- Distinguishing permissions between employees and customers
- Unified constraints for OpenAI, Gemini, and custom models
- Recording a complete audit trail for post-incident investigations
- Cross-session anomaly/abuse detection, rate limiting, and threat profiling
The product features Rakshak as a real-time guardrail engine and Kavach as the control plane. A working demo is currently available, and they are seeking pilot teams with real-world chatbots, RAG systems, internal copilots, and agents.
More from coding & agent
- Grok 4.5 is now free inside Cursor, the popular AI coding IDE — mark_k · 2026-07-21
- Travel MCP Server adds flight, hotel, weather and budget tools for agents — modelcontextprotocol · 2026-07-21
- OpenAI hackathon project stalls as Codex struggles on voice, while Claude spots the issue — ColleenMBrady · 2026-07-21
- Douyin Video Analysis MCP turns share links into structured video summaries — modelcontextprotocol · 2026-07-21
- An indie builder open-sourced 50+ AI apps and says users should only pay for tokens — matchaman11 · 2026-07-21
- Shared agent workspaces fail in a fixed order, from stale reads to zombie writes — mrvladp · 2026-07-21