AWS open-sources Infinity: a runtime that sleeps idle agents for extreme concurrency

AIFlow_ML · x · 2026-10-25

AWS and UC Berkeley open-sourced Infinity, a runtime that puts waiting agents to sleep to enable extreme agent concurrency.

The viral claim — 75,000 AI agents fitting in the 8 GB of a Raspberry Pi 5 — is real math but not a real Pi test: the benchmark ran on one thread of an AMD EPYC with a simulated model, and the Pi number is extrapolated. The author argues the underlying idea (suspending idle agents for massive concurrency) is the most useful agent news of the week. Official AWS blog post and Apache-2.0 code are linked.

Original post →

More from coding & agent

coding & agent channel →