How BMW governs hundreds of agents across 12,500 developers and 500M lines of code
AWS ML Blog · rss · 2026-11-20
AWS ML Blog details BMW R&D's playbook for building and governing agents at scale: 12,500+ developers, 500M lines of vehicle software, 1,300+ microservices serving 24M vehicles.
Key practices, all codified as infrastructure-as-code:
- Governance externalized: auth, rate limiting, and content filtering enforced at the integration layer (MCP gateway, central agent registry), not in agent codebases — so rules survive framework migrations and model swaps
- Graduated autonomy per step, not per agent: Level 0 human-in-the-loop → Level 1 human-on-the-loop → Level 2 autonomous within deterministic guardrails, expanded based on eval data
- Deterministic enforcement in CI/CD: policy-as-code checks gate deployments outside the agent's reasoning loop; egress controls block secret leakage
- Instrument and evaluate continuously: OpenTelemetry trajectory tracing; deterministic regression verification runs first, then LLM-as-judge evaluation against ground-truth datasets; model routing decisions logged with justifications
- Start focused, design for composition: five artifacts required before building — scope, interaction model, unambiguous tool definitions, ground-truth dataset, and evaluation criteria — to avoid bloated generalist agents
More from coding & agent
- Ex-Googler open-sources a CLI that lets Claude Code and Codex chat in one room — thechrisperry · 2026-11-20
- Beaker autonomously finds 100+ grading errors across five popular AI benchmarks — VictorSanh · 2026-11-20
- Burkov spots Codex quirk: suggested follow-up knows the agent screwed up, but the agent doesn't — burkov · 2026-11-20
- QuixiInfer author: tell Claude 'defeat is not an option' to make it write kernels for your GPU — QuixiAI · 2026-11-20
- OpenAI's Codex repo has 27,802 open issues: agent harness maintenance compared — SuaveSteve · 2026-11-20
- Dev argues terminal/tmux is the wrong form factor for managing 5-10 AI agents — DuaneJRich · 2026-11-20