Armory: Serving 10+ Robots Concurrently on a Single GPU with Real-Time Scheduling

danfei_xu · x · 2026-08-03

Serving latency in robotics can cause task failure or safety risks, unlike typical LLM serving. To address this, researchers introduced Armory, a system designed for serving large robot policies to fleets from the cloud or edge.

By scheduling action chunks in real-time, Armory enables concurrent serving for 10+ robots on a single GPU. In real-world tests on heterogeneous fleets, it boosts task throughput by up to 18% over baselines.

Related event: Armory System Serves 10+ Robots on a Single GPU(3 posts)→

Original post →

More from Embodied

Embodied channel →