Lumo-2 Speeds Up Inference with Block-Wise Decoding

rohanpaul_ai · x · 2026-07-18

This part supplements the inference optimization of Lumo-2: it uses block-wise decoding, generating several weakly related tokens at once instead of one by one for 32 action tokens.

On a single NVIDIA RTX 5090, Astribot reports latency reduced from 253.66ms to 93.53ms, achieving a 2.71x speedup.

The post also mentions that the model makes the action space a shared representation, making it easier to transfer skills between different robot embodiments.

Related event: Astribot launches Lumo-2 with real-robot demos(10 posts)→

Original post →

More from Embodied

Embodied channel →