AWS Introduces Rate Limiting for Bedrock AgentCore Gateway

AWS ML Blog · rss · 2026-08-07

Amazon announced support for rate limiting on the Bedrock AgentCore gateway, giving developers fine-grained control over AI traffic. The feature allows per-user control based on OAuth or IAM rules for requests per minute (RPM), concurrent connections, and token throughput (TPM), ensuring downstream services remain available during heavy traffic spikes.

The gateway supports three target types: MCP targets, inference targets, and HTTP passthrough targets. Rate limit configurations consist of dimension keys and entries, enabling developers to group traffic into distinct rate buckets using targetName, toolName, or identity claims (e.g., JWT). The system enforces a two-layer mechanism combining service-managed quotas and customer-defined limits to prevent any single caller from monopolizing gateway capacity.

Original post →

More from coding & agent

coding & agent channel →