Amazon Bedrock's Capacity-Pooling Paper Hits SOSP'26
tianyin_xu · x · 2026-09-30
Amazon's team presented their Bedrock systems paper at SOSP'26 in Prague. The core questions: how to pool capacity across Regions, keep GPUs busy, and enforce quotas — deceptively simple problems that, as the author jokes, consumed an entire summer. Co-authored with the Bedrock team.
More from Infra
- netkit paper: container network namespaces cost up to 31% throughput on Linux — tianyin_xu · 2026-10-01
- Dev sorts PCIe issues, spins up 7-GPU local rig with 6000 Pro and 6000 ADA cards — TheZachMueller · 2026-10-01
- Ben Bajarin: HPE and others use 'scale-out' vs 'scale-up' in conflicting ways — BenBajarin · 2026-10-01
- NVIDIA and Nous Research detail agent tracing with NeMo Relay across 108-run eval — NVIDIAAI · 2026-10-01
- stuntd 0.1.2: local heads answer confident LLM calls, weakest field caps the hit rate — Inevitable-Log5414 · 2026-10-01
- Framework Desktop with 192GB RAM opens pre-orders at $6,799, ships November — gnukeith · 2026-10-01