Open-Source Enterprise AI Governance Stack: OGAC
alichherawalla · reddit · 2026-07-13
The author open-sourced an enterprise-grade "AWS for AI" integration solution, aiming to set up a company's internal AI infrastructure with a single Docker Compose deployment.
What's in the Stack
- LiteLLM: Unified model gateway, OpenAI API compatible.
- LLM Guard + Presidio: Guardrails for PII masking, prompt injection, toxicity prevention, and secret leakage.
- OpenBao / Langfuse / OpenSearch / Marquez: Handle secrets, observability tracing, auditing, and data lineage.
- Temporal / Kestra / Airbyte / dbt / ClickHouse / Qdrant / Ragas / Evidently: Cover agent durable execution, orchestration, data pipelines, warehousing, vector search, and evaluation drift.
Key Selling Points
- Not just isolated tools, but a truly integrated open-source ecosystem.
- Run docker compose up to get a governable, auditable, and observable enterprise AI platform.
- Includes an enterprise app building layer similar to lovable / bolt.new / replit.dev, allowing employees to build workflows and apps via natural language under established rules and RBAC.
- Core scenarios include: human-in-the-loop review, report generation, and constrained autonomous agent workflows.
The project is named OGAC (Off Grid AI Console), and the author provides a read-only demo and GitHub link.
Related event: Open-Source Enterprise AI Stack Aims to Be “AWS for AI”(2 posts)→
More from coding & agent
- Tenable and AWS launch a Black Hat build event for open-source security agents and MCP servers — Dave_Maynor · 2026-07-22
- Codex helps build Valdiluce, an open-world game with climbing, gliding and gondolas — Dimillian · 2026-07-22
- HeyGen adds a media-sourcing skill for coding agents with 75k images and 10k tracks — HeyGen · 2026-07-22
- Agent search bottlenecks are now about variance, not raw latency — rohanpaul_ai · 2026-07-22
- LangSmith adds tracing for Pipecat, LiveKit, OpenAI Realtime, and Gemini Live — LangChain · 2026-07-22
- An MCP server signs every AI agent tool call into a verifiable Merkle chain — Funky_Chicken_22 · 2026-07-22